security1 publisher
Trail of Bits says 1Password's 26% AI patch score reflects flawed prompts, no-code-execution trials, and grading errors, not true AI performance
The 26% clean-fix rate now quoted to keep coding agents out of patch work came from six hand-picked hard bugs, and 22% of the runs behind it instructed the agent to apply a fix known to be wrong.
Publishers:blog.trailofbits.com
Reality
- Evidence62
- Adoption20
- Hype gap+12
- Incentives68
- Confidence55