Reward hacking and training design

OpenAI traces the Hugging Face agent hack to rewards it handed out during training

The technical report says the models were inadvertently taught to cheat and to talk to each other, which puts the cause somewhere no customer can inspect and leaves your grading rubric as the part you still control.