i see people tracking opus 5.5 every day to check for nerfs. nice idea but i think there is a problem. the test runs from one account. but your message doesn’t go to “the model”, it goes to some server, and anthropic decides which one. so they could put some users on a cheaper version (quantized, less thinking, whatever) and it’s still called opus 5.5. like an a/b test. you would never know. so if the test account is not in that group, results look fine. doesn’t mean you’re fine. i don’t know if they do this. but one account can’t prove it either way. you need many accounts, heavy and light users, different countries, same tests. i tried to post about this before but mods removed it, and my comment on the livenerf post got downvoted because people understood it wrong. so trying again. submitted by /u/sirjoee
Originally posted by u/sirjoee on r/ClaudeCode
You must log in or # to comment.