Embrace The Red reports 60 to 80 percent success on a small sample where an Anthropic-commissioned evaluation scored 0.00 percent across 720 runs, and the difference is mostly in what each test could measure.
Publishers:embracethered.com
Reality
- Evidence57
- Adoption46
- Hype gap+14
- Incentives63
- Confidence53
Anthropic reports that users accept 93% of Claude Code permission prompts. Its replacement is a classifier that judges each action, and switching it on revokes the blanket allow rules teams wrote for convenience.
Reality
- Evidence44
- Adoption20
- Hype gap+16
- Incentives76
- Confidence52
Johann Rehberger's chain landed 60% to 80% of the time in the mode Claude Code has run by default since mid-August. Anthropic closed the report as informative and pointed customers at OS-level isolation.
Reality
- Evidence58
- Adoption45
- Hype gap+5
- Incentives62
- Confidence52
Anthropic says per-action human approval degraded into a rubber stamp inside its own products. The control it now spends most of its engineering on is what the agent can reach.
Reality
- Evidence55
- Adoption58
- Hype gap+8
- Incentives72
- Confidence56
Anthropic's own study found users approved 97% of prompts and caught 13.6% of harmful actions. From August 14 the click stops being the safeguard, and deny rules become the job.
Reality
- Evidence38
- Adoption44
- Hype gap+8
- Incentives58
- Confidence41