Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
So, at your company, what are you doing about the spiking token | Tech Twitter
Press Space to continue
So, at your company, what are you doing about the spiking token prices?
Approaches I hear:
1. Inference routing - route more basic workloads to a LOT cheaper APIs or providers
2. Use cheaper open models for inference (eg Fireworks, Baseten etc)
3. Default model: cheap one
