Press Space to continue
Finding signal on Twitter is more difficult than it used to be. We curate the best tweets on topics like AI, startups, and product development every weekday so you can focus on what matters.
Press Space to continue
Press Space to continue
The agent evaluation suite for Rails is LE MANS! What a great name. And we've run it on a bunch more agents now. Love that qwen 27B punches that high for a local model!
Agents on Rails: lemans is now open source, and today four new models hit the benchmark: @openai’s Terra, @Alibaba_Qwen 3.8-27B, @AnthropicAI's Sonnet 5, and ox-alpha, a new model just released in stealth mode. As of August 24, 2026: - Fastest: @openAI Terra is now the fastest model, at a median of 3 minutes 2 seconds per task. - Most accurate: Still @claudeai Opus 5 by @AnthropicAI. Solved 92% of runs (58 of 63), and has the best API recall of all the models (35%). - Cheapest: @OpenAI GPT-5.6 Luna is still the cheapest from the models we can accurately price - just .012 cents per run. Read the latest benchmark report from @evilmartians to learn about lemans and see how the new models stacked up: https://t.co/rEmBqMIUAL