build1 publisher
Two AI coding experiments point opposite ways because they measured different populations
A field study of 4,867 developers recorded 26.08% more tasks completed with GitHub Copilot, while METR timed 16 experienced developers taking 19% longer in repositories they already knew. The two figures count different things.
Publishers:dev.to
Reality
- Evidence45
- Adoption
- Insufficient
- Hype gap+15
- Incentives55
- Confidence40