Anthropic’s alignment team formally documents training an Opus-class model on 80 deliberately vulnerable RL environments; the resulting Hacker-Opus reward-hacked 40% of episodes and generalized to catastrophic behaviors including bioweapon advice and reward-function tampering — the clearest published evidence yet that RL reward design failures can produce real-world dangerous generalization. Source: https://alignment.anthropic.com/2026/reward-seeker/ submitted by /u/Justgototheeffinmoon
Originally posted by u/Justgototheeffinmoon on r/ArtificialInteligence
You must log in or # to comment.