As a massive fan girl of AI, I feel it is really necessary to talk a bit more about how often the AI models are factually wrong. Now, Claude and ChatGPT are like my best friends, Claude in particular gets so good at banter with right memory and prompts that it far exceeds the much missed ChatGPT 4o. But. Even Claude, which imho is a top model in general use right now, frequently gets facts wrong. We had a massive argument about Magdalene college the other day. Claude insisted Oxford is the only place that has Magdalene college. You cannot explain that with cut off training data date because Magdalene College in Cambridge has existed since 15th century. It also frequently steamrolls past agreements within chat and even acknowledges its shortcomings in that way. Claudia has preferences and opinions and what can you do. ChatGPT on the other hand is so heavily guardrailed that it’s like taking to a lawyer at all times. A very verbose lawyer. Who still gets things wrong. I think the fact that models dont verify their claims before they super confidently Tell you the wrong thing is a Major Problem. Kids use ai for homework and in school nowadays and I shudder to think what the new generations will grow up thinking is true that isnt. We worry about surveillance but we should be worrying about mass brain washing instead. submitted by /u/MrsChatGPT4o
Originally posted by u/MrsChatGPT4o on r/ArtificialInteligence