I’ve only just found my way into these Chinese API transfer stations, where you can get 50-90% off the official price. However I’ve also found that most of them don’t have upstream prompt caching, meaning as context grows - every hit comes out of the input price, which is super expensive. I’m a dev and I use AI to code so, having long sessions burns through token so fast. Is there something I’m missing? It seems counter productive to have such cheap price, but end up needing 100X more tokens just to get back to what the official API gives. Are there transfer stations where there is prompt caching enabled? submitted by /u/uneatenbreakfast
Originally posted by u/uneatenbreakfast on r/ArtificialInteligence
You must log in or # to comment.