Metric Gaming and Goodhart Effects

Benchmarks are contaminated by design: your eval set should be one nobody has published

A dev.to argument on why benchmark charts mislead holds up on the mechanics: fame puts test sets into training data, and vendors pick which bars to show. The fix is an eval nobody outside your team has seen.