build1 distinct publisher
Matching Opus on tasks solved took Gemini Flash 87 more steps per run
JetBrains put two frontier models through the same coding agent, which scored them as a tie on tasks solved even though the runs differed by 47% in steps and 2.25x in dollars, and that gap is what procurement actually pays.
Publishers:blog.jetbrains.com
Reality
- Evidence48
- Adoption18
- Hype gap+12
- Incentives68