Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
We just landed some big infra upgrades for the Gemini Batch API: | Tech Twitter
Press Space to continue
We just landed some big infra upgrades for the Gemini Batch API:
- p95 latency decreased by 80%
-p99 latency decreased by 68%
- batch success rate is now >99.998%
- 98% reduction in batch expirations
- added support for partial batches
great work by the team to land this!!
