science1 distinct publisher
Two harnesses put the same model 37 points apart on ARC-AGI-3
ARC Prize scored GPT-6 Astra at 62.7% on ARC-AGI-3 with its standard harness and 99.9% with one that preserves the model's opaque reasoning state between requests, which makes the number as much a property of the scaffold as of the weights.
Publishers:arcprize.org
Reality
- Evidence45
- Adoption
- Insufficient