The more I think about DRIFT in LLMs and how scientists and developers try to stop LLM from drifting, the more I realize that all those people seem to not understand that DRIFT s a universal thing - and that way can not be stopped from happening. Think about us humans - evolved over millions of years… We drift too - or hadn’t you ever thoughts about “how can I fix this quicker” or “wait there’s a shortcut to get to the result”? Hell yeah - in Llms we call this drifting - right? And what solution do we humans have to avoid drifting? Especially in critical tasks? Right - we stick to manuals, to notes that tell us the order of things to follow. We have supervisors checking on our work and our results. And these are all OUTSIDE harnesses ! These are no things that run or happen inside our brains! Logical conclusion: Drift is a universal constant and can not be stopped or avoided. Instead drift can only be controlled and contained thru outside forces! submitted by /u/Inevitable_Raccoon_9
Originally posted by u/Inevitable_Raccoon_9 on r/ArtificialInteligence
You must log in or # to comment.