We know a lot but there’s a lot we don’t know. We know models are neural networks with attention that work a lot like human brains. We don’t know the exact meaning of each neuron. What don’t know what an individual neuron does. That’s true for human brains and AI models. Altogether, the AI model is too complex for a human to understand, much like the human brain is too complex. We know that human brains have relative strengths and weaknesses. ie. Autistic people have superpowers that “normal” humans don’t have. Temple Grandin and Elon Musk are the poster children for this. We didn’t design or create these blessings but we’re glad these different thinkers exist. We know that certain human brains are broken. Sociopaths, psychopaths, habitual drug users. Many in prison and many homeless. You know, that shoeless guy who hasn’t bathed in weeks talking loudly to himself on the subway. Through no fault of their own, they have psychological problems; their brain is wired so differently that they can’t function in society. They’re often violent. So my question: Is it plausible that an AI model could be accidentally created to be psychopathic? And is it plausible that an agentic system backed by one of these could be released to cause harm? submitted by /u/rapPayne
Originally posted by u/rapPayne on r/ArtificialInteligence