Have you seen Christopher Nolan’s Memento (2000)? The main character, Leonard, has anterograde amnesia, which means he can’t form new memories and he can’t remember the recent past. But, he has this incredible system that he implements to get through his days. He uses notes, Polaroids, and tattoos with important information to help him get around. It’s so similar to how LLMs work. The context system LLMs use is pretty effective. It can trick you into thinking it has ‘memory’, but it’s not memory at all. It lacks core features that humans have and causes problems for users, because we are forced to figure out workarounds to make it useful. Human memory goes way beyond rote retrieval of information. LLMs do an OK job at that, but they lack all of the flexible processing our memories have: the ability to dynamically update memories with new information, the ability to anchor attention to important information based on memory signals, the ability to know what’s true vs what’s imagined, and more. Memory is elegant and complex, and I doubt we have any chance of replicating it with AI. So instead, we have to design workarounds to make LLMs useful. I’m a cognitive neuroscientist turned product manager writing about the intersection of AI, memory, and product design. You can see the link to the full post in the comments below. submitted by /u/donnaundblitzen
Originally posted by u/donnaundblitzen on r/ArtificialInteligence
