Output Validation Gates

Judging the cheap model's output beats guessing which prompt is hard

One team's forty lines of Go moved 81% of requests to a cheaper model and cut the bill 71%, but the arithmetic says the win came from a boring traffic mix and a wide price gap, and the bill it pays is tail latency.