Original Reddit post

There’s a move that has become common in discussions of AI: pointing to widespread adoption as a rebuttal to criticism. If millions of people are using it, the argument goes, the concerns must be overblown. Writing in Tech Policy Press, Eryk Salvaggio argues the opposite. That people are using language models, he writes, “doesn’t make criticism of them irrelevant. It makes it urgent.” The piece centers on agentic AI: systems that, in Salvaggio’s framing, “plan,” generating code that writes more code and executing multi-step actions across apps and models. He builds on the foundational 2021 paper in which Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Margaret Mitchell described LLMs as “stochastic parrots – systems that reproduce statistically likely patterns from training data.” Agentic systems, Salvaggio writes, “stack these parrots into interacting outputs – a stochastic flock.” The underlying limitations don’t disappear when you chain the models together; they compound, and they become harder to see. The stakes climb further when the deployer is a government. Salvaggio points to pressure on government agencies to use these systems for automating benefits decisions, contract analysis, and regulatory review – areas where cascading failures can have serious human consequences. Code in these contexts “must be considered untrustworthy until it’s verified,” and the defining feature of the agentic model is producing output faster than verification can keep pace. Agentic systems also “loop repeatedly, consuming far more resources than more purposefully built software,” a cost that concentrates in computational infrastructure. The broader pattern he names is computational solutionism: access to code generation pulls organizations toward solving policy challenges with new lines of code, even when the problem is not a coding problem. submitted by /u/Justgototheeffinmoon

Originally posted by u/Justgototheeffinmoon on r/ArtificialInteligence