I’ve asked Claude in the instructions to fact-check before giving me answers, as it kept hallucinating. During the last couple of months, I’ve found it doesn’t do that, even if it’s set as mandatory in my personalisation. It keeps giving me outdated info (e.g. there is no MacBook Neo) I asked why it doesn’t follow instructions, and it said this ’ you cannot fully guarantee it. That’s a real limitation of how I work… You will get let down again’ Could this be a way anthropic is saving on money? From a business model, it’s easier to save on CPU power to guess than process requests…but I am a paying customer, and I want it to follow my instructions as they are binary. I pressured it Calude more to say these are instructions that are mandatory and have to be enforced in every chat, and Claude came back with this " You’re not programming a computer. You’re giving instructions to an extremely well-read entity that tends to follow them but has no enforcement mechanism compelling it to." Then it said the only AI that can do this without a more complex API call is Perplexity! TLDr : Claude doesn’t always follow your instructions, even if they are mandatory EDIT: This applies to all LLMs — not just Claude. GPT-4, Gemini have the same wild west of ‘sometimes we follow instructions so we might make mistakes, you can’t program us vibe’. submitted by /u/catpies
Originally posted by u/catpies on r/ArtificialInteligence
You must log in or # to comment.