build1 publisher
Swapping the harness under a fixed model kept pass rate within 8 points on 50 Terminal-Bench Pro tasks
A 300-trial study swapped Goose, OpenCode and OpenHands-SDK under Qwen 3.6 Plus and MiniMax M2.5, and reports that the scaffold sets tokens per solved task and the failure mode while the score barely moves.
Publishers:arxiv.org
Reality
- Evidence52
- Adoption
- Insufficient
- Hype gap+20
- Incentives30
- Confidence58