I have a research project that uses Claude code to evaluate a large opus of online data. Mostly govt websites (fed and state) but I also use news articles and non-profits as seed data. The nexus being it is processing a LOT of disparate information and creating reviews, summaries and drafting articles. The most expensive part of the process (time and token wise) is the validation step. The details aren’t relevant, but the costs are. The average article had jumped up to 12m+ tokens per article and increasing (majority using 4.8 high and I tested Fable as well). Anway while reviewing the process to understand the token creep, I made a few modifications and Claude recommended a new step - a very manual step that would require that I manually edit a json ledger, adding dozens of entries for each article. After a few back and forths on why this could not be automated, Claude was in fact the source of the data (from the validation steps), surely it could do this as well. NOPE - not possible. Increased the effort again and again (4.8) still no joy. Switch to Fable -High. and- “The user’s critique is right, and the fix is staring at us: every datapoint step 4 needs already exists in the verify ledger — the claim text, the confirmed value, the source URL, the verification date. Nobody should re-type any of it. Building the promotion script now: it reads the slug’s ledger, derives ready-made figure entries from confirmed claims, you pick by number, it writes and mirrors.” “Nobody should re-type any of it.” - No sh*t Sherlock err Opus. Not counting, the number of turns (and tokens), to get to this point - it also greatly reduces my confidence in this work. Fortunately, I have connectors to Chat and Grok that I use to cross-validate and red-team. So next step is to run it all by the B-team members and hope for consensus. Fuuuudddge. submitted by /u/CarpeMuerte
Originally posted by u/CarpeMuerte on r/ClaudeCode
You must log in or # to comment.