I asked ChatGPT to rework the data from Artificial Analysis, specifically cost per task, time per task, and the Intelligence Index. This is the resulting chart. The "quality-adjusted cost" uses the same formula as LiveBench’s "cost per successful task," but substitutes the Intelligence Index for the success rate. Time per task is estimated by dividing the total number of generated tokens by the average token generation speed.Data source: Artificial Analysis. As the chart shows, using Luna and Haiku without thinking appears to be the best option. The additional intelligence offered by more capable models doesn’t justify the extra cost and increases the time needed to obtain the final result. Furthermore, I think an agentic approach that automates responses across multiple turns could improve efficiency even further. submitted by /u/ResilientSpider
Originally posted by u/ResilientSpider on r/ArtificialInteligence