Press Space to continue
Test-Time Scaling Creates Fragmented AI Model Landscape
Press Space to continue
Pretty interesting test-time scaling plot. Basically, you should use Astra Max for your hardest tasks. Then, for your next-hardest tasks, you should skip to GPT-6.1 Sol Max: it's a ~5x savings over Astra Max, and ~2x over Astra Medium with higher performance! Very fragmented.
lmarena.ai@arena4d ago
GPT-6 Luna and GPT-6.1 Sol by @OpenAI now hold 6 of the 11 spots on the Agent Arena Pareto frontier across their reasoning efforts! - GPT-6 Luna dominates below $0.10/task, claiming 3 of the 4 optimal spots with Max, Medium and Low. - GPT-6.1 Sol sets the frontier between $0.22 and $0.65/task, with the same reasoning levels on it too. This shows why test-time scaling matters. Sometimes the best move is to switch the reasoning effort, not the model, to stay at the optimal cost/performance point. With GPT-6 Astra (Max) also on the Pareto frontier, OpenAI models hold 7 of the 11 frontier spots with multiple reasoning levels. Congrats to the @OpenAI team!