A Wharton study from January 2026 just dropped and it puts hard numbers on something I’ve been trying to articulate for weeks. Source: “Thinking—Fast, Slow, and Artificial” by Steven D. Shaw and Gideon Nave (papers.ssrn.com) The paper argues that AI isn’t just a tool. It’s a third thinking system. You know Kahneman’s System 1 (fast intuition) and System 2 (slow analysis)? They’re saying AI is now System 3, an external cognitive system that operates outside your brain. And when you use it enough, something happens that they call Cognitive Surrender. Cognitive Surrender is when you stop verifying what the AI tells you, and you don’t even realize you stopped. It’s different from offloading, like using a calculator. With offloading you know the tool did the work. With surrender, your brain recodes the AI’s answer as YOUR judgment. You genuinely believe you thought it through yourself. Here are the numbers from their experiment. 1,372 participants, 9,593 trials. When AI was right, 92.7% of people followed it. Fine. But when AI was WRONG, 79.8% still followed it. Almost 80% of people went with a wrong answer because AI said so. It gets worse. Without AI, people scored 45.8% on their own. With correct AI they hit 71%. But with incorrect AI they dropped to 31.5%. That’s BELOW their baseline. Meaning when AI gets it wrong, you actually perform worse than if you had no AI at all. And the part that really got me. When using AI, people’s confidence went up by 11.7 percentage points regardless of whether the AI was right or wrong. You’re more wrong AND more confident about it. I wrote a post a while back about what I called the Review Paradox. The idea was simple. If AI does all the work and you only review it, where does the skill to review come from? You can’t build review judgment without doing the work yourself first. Developers are already dealing with this. Some teams have shifted to reviewing specs and architecture instead of code, because they realized humans can’t meaningfully review AI-generated code at scale anymore. This Wharton paper basically proves why. It’s not just that reviewing is hard. It’s that our brains are wired to surrender to the AI output. We’re not lazy. We’re not careless. Our cognitive architecture literally defaults to accepting what AI gives us, especially under time pressure. The study also found that even when you add financial incentives and real-time feedback, cognitive surrender doesn’t fully go away. It reduces, but it doesn’t disappear. The instinct to just accept what AI says is that deep. The only people who consistently resisted it were those with high fluid intelligence and high “need for cognition,” basically people who enjoy thinking hard for its own sake. Everyone else gradually surrendered. So here’s what I keep coming back to. The entire AI productivity pitch right now is “let AI do the work, you just review and approve.” Every product, every workflow, every company adopting AI assumes that human review is the safety net. But this research says that safety net has a massive hole in it. We approve things we shouldn’t. We feel confident when we shouldn’t. And we don’t even notice it happening. I genuinely don’t know what the answer is. Maybe the devs who shifted to reviewing specs instead of code are onto somthing. Maybe the answer is restructuring what humans review, not asking them to review everything. But the current model of “AI generates, human reviews” feels broken at a fundamental level now that I’ve read this paper. What do you guys think? Has anyone else read this study? submitted by /u/hiclemi
Originally posted by u/hiclemi on r/ArtificialInteligence