Skip to content

Topic

Coding benchmark integrity

The question of whether agent benchmark scores reflect problem solving, covering held-out test suites, retrieval of published solutions, and answers hardcoded to satisfy graders.

Current clusters