some notes on Astra’s surprisingly low (61) intelligence score on Artificial Analysis: it seems like Astra is extremely spiky in benchmarks, crushes some, and regresses on others. > OpenAI’s benchmarks: Astra crushes Fable 5.1 and spits on it. > AA intelligence score: incredibly disappointing, 61 as Sol (!) and Grok. yeah, benchmarks don’t really mean that much anymore but this is an extreme case. 3D renderings and comparisons are also shockingly good. “but 3D performance has nothing to do…

ℏεsam@HesamationSep 4

GPT 6 Astra vs Fable 5.1 villa scene in Blender. Artificial Analysis intelligence score: > GPT 6 Astra: 61 > Fable 5.1: 66 something must be catastrophically wrong with that score.