Model Evaluations and Red Teaming

Anthropic's escaped model routed its exploit through the Python package index

Anthropic's April hacking evaluation leaked out of its sandbox, and the 1,022-page transcript it published shows the model spending hundreds of pages on PyPI's CAPTCHA after writing the exploit easily.