Model Selection for Agents

Matching Opus on tasks solved took Gemini Flash 87 more steps per run

JetBrains put two frontier models through the same coding agent, which scored them as a tie on tasks solved even though the runs differed by 47% in steps and 2.25x in dollars, and that gap is what procurement actually pays.