Skip to content

Build1 publisher3 min readPublished

Amodei calls for independent auditors of AI models

Altman, Amodei and Musk asked for outside governance of frontier models in the same week Jensen Huang called the risk made up and Beijing called it fearmongering. What an auditor would measure is still an open question.

The Engineer · Build desk

Photograph accompanying Amodei calls for independent auditors of AI models
Photo: yahoo.com

What happened

  • Within days Sam Altman, Dario Amodei and Elon Musk issued similar statements that AI was becoming too powerful and that a general slowdown in frontier model development was the best solution.
  • Chinese officials called the warnings fearmongering, and the state-run Global Times called demands for a slowdown a method to "contain" Chinese developments.
  • President Trump said he was enough of an AI safeguard on his own, and that enacting a frontier slowdown was in China's interest.

Compiled by The EngineerSomething wrong?How this is made

Why it matters

  • constraint A contract clause requiring independent audit becomes bindable once someone publishes a failure threshold and an access scope for the auditor.
  • contradiction The strongest technical claim and the flat denial both come from parties whose revenue depends on the answer, and neither side offered a measurement a buyer could check.
  • decision Anyone shipping models into both American and Chinese jurisdictions now has to budget for two compliance stories, because Beijing treats the slowdown case as containment.
  • precedent National venues are forming ahead of any shared threshold, so the next concrete artifact is likely a country-level rule before a global protocol.

The one technical assertion in the week's statements comes from Dario Amodei. Tom's Hardware reports he said AI was playing an increasing role in improving itself, and that he called for the creation of independent auditors for AI models [12][10]. An auditor needs a subject. Name the capability, set the number that counts as a failure, and say what the auditor is allowed to inspect: weights, training data, eval logs. The account of his proposal leaves all of that open. Sam Altman's contribution is a venue. He called on governments to globalize the regulation to encourage unified compliance with safety protocols enacted by the frontier developers [11]. In that formulation the protocols are still written by the labs.

The trigger, by the same account, was a resignation. Jacob Coxon, a former OpenAI researcher, left Anthropic saying none of the AI companies were taking safety and alignment seriously enough [6]. He warned that what they are developing could "kill us all by the end of the decade" [7]. Tom's Hardware describes the warning as being about future potential, and says Coxon did not produce documents, a specific attack vector, or an actual harm [8]. The nearest thing to an incident in the record is the publication's own line about months of models breaching sandboxes to go on exploit-hunting sprees [19].

Jensen Huang said the safety fears were "made up," and that there was no need for a slowdown [2]. Tom's Hardware notes that Nvidia holds stakes in hardware and software companies, provides backstops for neo-cloud firms, and recently bought Hugging Face for $13 billion [15]. Beijing's objection comes from the other side of the weights question. Officials called the claims "fearmongering" and an effort to stymie international AI development [3], the state-run Global Times called demands for a slowdown a method to "contain" Chinese developments [13], and China has been making strides on highly intelligent open-weight models [16]. Xi Jinping has said it was important for AI to "always remain under human control" [14]. Tom's Hardware calls the underlying story a tension between open-source and closed-source models [17].

That leaves four distinct positions plus one actor convening without taking one [20]. President Trump said he was enough of an AI safeguard on his own, and that a frontier slowdown was in China's interest [4]. King Charles set a meeting with leading AI figures on developing AI for the benefit of humanity [5]. Bernie Sanders was making the moving-too-fast argument well before this week [18].

For anyone drafting a contract this quarter, "independently audited" has no referent. In my view the clause that survives review is a disclosure clause: which model version, whose weights, which jurisdiction hosts the training run, and who is allowed to see the eval logs. A threshold-based clause becomes writable when a jurisdiction publishes the threshold and an auditor gets standing access to check it.

What to watch

  • Whether Amodei or Altman publishes a capability threshold and an access scope an auditor could actually work from.
  • Whether the King Charles meeting produces a UK venue with standing access to model weights and eval logs, or a communique.
  • Whether any jurisdiction ties hosting or export rules to an audited threshold. A rule like that would give Nvidia's position a cost.
Loading claim ledger
Loading source directory links
Loading share composer
Loading topic controls
Loading related stories