build1 publisher
A production agent's LLM judge filed 113 of 114 state defects under brand voice
Exhaustive human review of a deployed food ordering agent found that its judge writes the defect down and then scores it on the wrong axis. The shipping gate trips only on hangs and hard assertions, so 100 rounds passed clean.
Publishers:arxiv.org
Reality
- Evidence58
- Adoption20
- Hype gap+14
- Incentives40
- Confidence55