Anastasios Nikolas Angelopoulos

There's some leapfrogging happening between Anthropic and the most recent Chinese model release. Basically they're in a race for the #1 model all the time. That said Fable 5.1 Max has taken quite a substantial lead this time. 80 Elo difference is no joke.

Gemini 3.8 flash is a big improvement over 3.7, especially in terms of user satisfaction. Double-digit lift in the percentage of explicit user praise. Also better at steerability and bash. It's cool to see that models can still see a raw 20% jump in performance these days.

If you are an academic studying the foundations of AI Evaluation, we'd love to work with you.