posting this as a PSA to myself more than anything. last month I had claude pull together what people hate about a competitor so I could position against it. came back clean, structured, confident, three neat complaint clusters, the whole thing. I built a landing page around the top one. felt great. turns out it grabbed like 4 comments off one thread and pattern-matched the rest. the “top complaint” was basically one guy. found out because a real user told me my whole angle was off. and the part that bugs me: it didn’t lie about the data. it lied about how much data it had. same energy as the test suite that’s green because it quietly redefined green. it’ll summarize half a thread and a whole thread with the exact same confidence and you cannot tell which one you got. no clean fix, just a rule now: I don’t trust any “here’s what I found” unless the thing tells me how much it actually pulled. the way I do research now literally returns a coverage number, thin / partial / saturated, so a thin pull announces itself instead of getting dressed up as the answer. that one number has saved me from at least two more dumb decisions. trust the receipts, not the vibe. how many of you have shipped something off a confidently-wrong agent summary? cannot be just me. submitted by /u/schequm
Originally posted by u/schequm on r/ClaudeCode