Original Reddit post

I find this passage very interesting from the book I’m reading, if anyone builds it everyone dies , I would like to get some insights or opinions from you people. What do you think of this? “The history of human ingenuity overcoming obstacles, great and small, is the history of people making mistakes and learning from them. Many inventors had a theory of flight and hurt themselves jumping off a hilltop before the Wright brothers came along. Even the optimistic idiots contributed their knowledge to the lesson books of science, so that civilization could do a little better next time. They risked and harmed only themselves, and all humanity benefited. When it comes to aligning an artificial superintelligence (ASI), humanity will not have the luxury of learning from sufficiently bad mistakes. This also means we can’t rely on the luxury of experience to tell us afterward whether the problem was so hard, so cursed by engineering difficulties, that we should not have tried. We have to figure that out in advance. ” submitted by /u/Resident_Chef_561

Originally posted by u/Resident_Chef_561 on r/ArtificialInteligence