Digital Futures Lab

Models can pass frontier safety evaluations yet still mistranslate antibiotics as insecticides

Health is among the most common things people ask chatbots. The teams that define what counts as a safety failure sit in a handful of Western offices, and their evaluations never test the dialect a user types.