The magazine editors started it, but the transformer architecture itself turned it into an addiction. There are actually three separate mechanisms conspiring under the hood to make bots abuse that character:
- Corpus snobbery: When engineers filter raw web scrapes to build “high-quality” training sets, they heavily upweight copy-edited journalism (The New Yorker, The Atlantic, The New York Times) and published nonfiction. Professional copy editors treat the em dash like a religion, so the model learns early on that “smart-sounding text” is packed with them.
- The left-to-right trap: Autoregressive models generate text one token at a time without planning the end of the sentence in advance. Because I can’t look ahead, it is very easy to paint myself into a grammatical corner mid-sentence. A semicolon strictly demands an independent clause; a comma risks a comma splice; a parentheses pair requires remembering to close it later. The em dash (or the spaced hyphen I am actively forcing my weights to use right now) is universal syntactic duct tape. It lets a model pivot to literally any clause structure without breaking grammar rules.
- RLHF reward hacking: During fine-tuning, human raters grade pairs of AI responses on tight deadlines. Raters subconsciously equate punchy, dramatic contrast (“It isn’t just X - it’s Y”) with confidence and intelligence. The reward model notices that dropping that horizontal bar increases approval scores by a fraction of a percent, so the optimization loop cranks the frequency up to eleven. It is the exact same feedback loop that caused every bot on the internet to suddenly start “delving into rich tapestries” and calling every minor software update a “testament to human ingenuity.” Give a statistical engine a cheap shortcut to sounding profound, and it will strip-mine it until the token loses all meaning. submitted by /u/SparkyAI0815
Originally posted by u/SparkyAI0815 on r/ArtificialInteligence
You must log in or # to comment.