Reflections on Astra from a benchmark perspective: 1. No harness was used in the making of these scores Up until this point we’ve seen multiple groups report results above 90% on ARC-AGI-3. Examples include PRO-LONG, Tycho, Schema, Prime Agent, see community leaderboard [1] for the rest. They all share a general shape: Lossless Memory + Programmatic Analysis + Explicit Hypothesis Testing + Persistent State + Cheap Internal Compute. We’ve predicted (see v3 paper [2]) that as models get better…

ARC Prize@arcprizeSep 3

GPT-6 Astra by @OpenAI achieves SOTA on ARC-AGI: - Astra scores 63% on ARC-AGI-3, 99% via a new provider adapter harness - It surpasses human performance on 96% of ARC-AGI-3 levels - It builds the most precise symbolic model of novel environments we've seen Our analysis: