I cant even make this up. A Bangalore District Court judge apparently used ChatGPT to write a legal judgment (O.S.No.4956/2011) and completely forgot to proofread it. They copy-pasted their actual prompts and all of the AI’s conversational filler directly into the final official document. FYI - link to the judgement Take a look at the screenshots. We can clearly read the AI offering to “Tighten the language further to match a specific Karnataka civil court style” and casually telling the judge to “Just say the word”. The official document then literally includes the user’s prompt asking the AI to “discuss the consequence” of some legal facts about the first wife passing away. It actually gets worse on the next page. the printed judgment features the AI asking, “If you want, I can now: Integrate this reasoning seamlessly into the Issues portion” and “Just tell me how you want to place it”. Right below that, the document immortalizes the judge’s prompt correcting the AI about a life interest, followed by the AI politely replying, “Got it – thanks for the correction” before typing out the next legal paragraph. This is an official court order, and it reads like a late-night tech support chat log. The fact that nobody caught this before it was published is absolutely wild. submitted by /u/StatSigEntropy
Originally posted by u/StatSigEntropy on r/ArtificialInteligence