Press Space to continue
Gemini 3.8 Flash Shows 20 Percent Performance Jump Over 3.7
Press Space to continue
Gemini 3.8 flash is a big improvement over 3.7, especially in terms of user satisfaction. Double-digit lift in the percentage of explicit user praise. Also better at steerability and bash. It's cool to see that models can still see a raw 20% jump in performance these days.
lmarena.ai@arenaSep 2
Gemini 3.8 Flash (High) by @GoogleDeepMind significantly improved in Agent Arena over Gemini 3.7 Flash (High), scoring +5.94% net improvement and ranking #14 overall—up from +0.84% and #32 overall for 3.7! Agent Arena measures net improvement relative to the average model across real-world, long-horizon tasks using web, filesystem, and terminal tools. We measure overall and dive deeper by five key signals: - Confirmed Success: explicit “yes, that worked” from users - Praise vs. Complaint: implicit sentiment in users reactions - Steerability: can the model course-correct when you push back? - Bash Recovery: how it recovers from CLI errors - Tool Hallucination: does it call tools that don't exist Of the five key signals we track, Gemini 3.8 Flash (High) demonstrates a massive gain in Praise vs. Complaint: users are reacting to its output with noticeably more positive sentiment. There is notable improvement in Confirmed Success, and Bash Recovery. Steerability remains a relative weakness, though it has improved compared with 3.7. Gemini 3.8 Flash (High) vs. Gemini 3.7 Flash (High): - Praise vs. Complaint: +14.78% vs -1.60% - Confirmed Success: +11.12% vs +9.80% - Bash Recovery: +4.46% vs +0.61% - Steerability: -1.43% vs -5.38% - Tool Hallucination: Scores were nearly identical, with neither model showing issues Big congrats to the @GoogleDeepMind team on this release!