build1 distinct publisher
Self-grading agents bank their own mistakes, and a second judge does not catch it
A paper on arxiv.org names the failure the Echo Gap: wrong episodes get inflated scores, then get retrieved more. The proposed fix needs a verifier whose errors are uncorrelated with the first grader's.
Publishers:arxiv.org
Reality
- Evidence34
- Adoption12
- Hype gap+22
- Incentives62
- Confidence44