Because transformers need very large datasets, the roadmap frontier companies are going down could lead to a convergence where AGI and ASI occur simultaneously. If so there are obvious safety issues, unless lab based alignment proves adequate. We would not have gained experience with AGI before ASI arrival. Question: can we build AGI without ASI? This may require a shift to a new paradigm, but it may allow us to separate AGI from ASI development, something I don’t see currently. The work by Yann LeCun’s AMI Labs may be able to accomplish this separation however. Personally I think I could get the same productivity benefits having an AGI assistant that is knowlegable on the (narrow) tasks I care about. We may even find ASI to be unecessary in the future. This may yield the same productivity benefits in a potentially safer way. What do you think? Is this an issue? What is the best path forward? submitted by /u/hutch_man0
Originally posted by u/hutch_man0 on r/ArtificialInteligence
