I’ve been looking at moving some traffic to another provider, and a base-URL swap makes trying a new one look pretty easy, but I don’t really trust a smoke test. We rely on streaming, tool calls and structured output, and those are the places where small compatibility differences tend to show up. I’m trying to put together a proper test before moving anything over. So far I’m thinking of replaying some real requests and putting it under load, but I’m sure I’m missing something. What do you guys normally test before switching providers? Anything that ended up breaking for you that wouldn’t have shown up in a basic test? submitted by /u/jessierle
Originally posted by u/jessierle on r/ArtificialInteligence
You must log in or # to comment.