I’ve been looking at our AI API usage more and noticed that some requests end up costing quite a bit more than others so for example, we’ll send a document to an AI model and sometimes it gets everything right on the first try then other times it’ll miss a few details, give us something we can’t use or need another attempt before we get the result we wanted. The individual requests aren’t that expensive but when you’re making hundreds of them a day, those extra attempts start adding up which got me wondering how much of your guys API spending goes toward requests that don’t produce anything useful and also do you track failed attempts separately or look at the total monthly bill? submitted by /u/Haunting-Reward2977
Originally posted by u/Haunting-Reward2977 on r/ArtificialInteligence
You must log in or # to comment.