We're adding a codex harness added to our ARC-AGI-3 agents repo We're doing ablations to find what tool helps the most * Codex - No tools * Codex - Scratchpad only (read/write) * Codex - Code only (read/write/execute .py) * Codex - Scratchpad + Code My guess is scratchpad will account for the majority of the perf increase. Code will help, but only on certain games that are logic heavy (instead of exploration heavy) Example scratch pad screenshot