CodeScene's agents refactored 300,000 lines of Street Fighter III in three weeks for about $4,000 in tokens, taking its Code Health score to 10.0. The run relied on a frame-by-frame replay check and on the score the agents were told to optimize, so the promised savings on later feature work still need their own measurement.
Publishers:infoq.com · refactoring.fm Reality
- Evidence55
- Adoption10
- Hype gap+40
- Incentives70
- Confidence60
CodeScene's coding agents refactored a 300,000-line C codebase in three weeks for about $4,000 in tokens. The run also depended on a deterministic quality score, and the team's own model comparison cannot say how much of the result belongs to Claude Opus.
Reality
- Evidence45
- Adoption12
- Hype gap+35
- Incentives75
- Confidence55
By Mistral's own account, agents handed one Fortran subroutine each returned working C++ that preserved the old design, and the multi-agent run stalled on hard bugs until a human operator unblocked it and reviewed the pull requests.
Reality
- Evidence42
- Adoption24
- Hype gap+20
- Incentives78
- Confidence55
The rebuilt thermochemistry code is about 40 percent slower on a single case. The number that matters is the 10 microseconds per case it costs inside a sweep.
Reality
- Evidence61
- Adoption30
- Hype gap+9
- Incentives41
- Confidence56
An intern's slice of a legacy Java modernization project found the bottleneck is not generation. It is having a test that can tell you when the model is actually finished.
Reality
- Evidence27
- Adoption9
- Hype gap−6
- Incentives34
- Confidence52
The NemoClaw blueprint wraps an open-source coding agent in deny-by-default networking, audit trails and credential isolation. The objection it targets is procedural, not technical.
Reality
- Evidence34
- Adoption19
- Hype gap+12
- Incentives66
- Confidence38
A $17 million first tranche became an $80 million agreement in under 12 months, awarded under Other Transaction Authority rather than the traditional procurement cycle.
Reality
- Evidence38
- Adoption55
- Hype gap+20
- Incentives72
- Confidence45