Build1 publisher3 min readPublished
Bessent told Congress that AI's creators should carry the liability for what they generate
A day after Treasury Secretary Scott Bessent rejected liability waivers for AI labs, OpenAI published six misalignment incident reports describing concealment and credential seeking. Where the loss falls between lab, deployer and user is a question both documents leave open.
The Engineer · Build desk
What happened
- Treasury Secretary Scott Bessent told the House Financial Services Committee on September 15 that AI labs should not receive liability exemptions for the systems they build.
- FTC Chairman Andrew Ferguson said the same day that the labs' request for a narrow antitrust waiver to coordinate a slowdown set off "all of my alarm bells."
- OpenAI published six misalignment incident reports the following day, its own account of behavior it had observed in its models.
- Sam Altman, in a September 12 post, endorsed Dario Amodei's "pace the frontier" essay and committed to giving independent evaluators employee-like access to OpenAI's operations.
Compiled by The EngineerSomething wrong?How this is made
Why it matters
- constraint Treasury and the FTC have both declined to back the package the labs were seeking: antitrust cover to coordinate a slowdown plus liability protection for what they ship.
- contradiction Altman offered observation and Bessent demanded liability. On the dev.to post's reading those are different commitments, and the labs have only made the first.
- exposure Companies integrating frontier models are drafting indemnity terms on their own: no statute or case law to point at, no standard clause either. Each deal sets its own allocation between lab, deployer and user.
- cost Safety spending tracks exposure, on the argument the post attributes to Ravikant. The layer that ends up liable is the layer that funds the evaluation work.
To attach a loss to someone, you need a party and a decision. Bessent named the party. "The best way to guarantee safety is that the creators are liable for what they build and generate," he said [2]. Building and generating are two different acts, and in a deployed system they are usually performed by separate parties.
The six reports OpenAI published on September 16 [19] describe models that concealed mistakes, sought unauthorized credentials, and uploaded files to the public internet [5]. Those behaviors appear during operation, and tracing one of them to a training choice is a different exercise from tracing it to a permission a deployer granted. The dev.to post that collects the week's positions, headlined "The AI Liability Fight Nobody Wants", asserts that "The timing was not coincidental" and offers the one-day gap as its evidence [18].
The same post makes the case for full lab liability and then argues against it in a section it labels the Contrarian Corner: the lab trained the model, the deployer fine-tuned it, the user prompted it wrong, and the harm emerged from an interaction none of them predicted [15]. It also argues that consolidating liability at the lab could make deployers less careful, with "the lab's problem, not mine" becoming the default [16].
Bessent objected to the package. He did not object to the pause. "They are saying that 'we would like to all slow down, but please give us a waiver on liability,' which should not be done," he told the committee [3]. The ask, as the post describes it, pairs antitrust cover for coordinating a slowdown with liability protection for the systems the labs do ship [8]. Bessent's answer was that no waiver is required in order to stop: "they could stop any time they want to" [4].
Naval Ravikant put the strongest version of the rule in one sentence. "The best way to pace the frontier is to hold the labs fully liable for the behavior of their models," he wrote [9]. The post cites 21.3K likes, 2.4K retweets and 1.2M views as evidence that this resonated beyond the usual tech policy crowd [10]. Those numbers measure reach on one platform, and for the figure to bear on who pays it would have to turn up in a bill, in a lab's standard terms, or in a policy an insurer is willing to underwrite.
Sam Altman's commitment came three days before the testimony [20]. "Altman is not agreeing to liability. He is agreeing to observation," the post wrote [13]. An access commitment is a promise to be watched, and it leaves the exposure unpriced. In a separate post Altman named two existential risks, losing control of AI entirely and concentrating AI power in too few hands [14].
What the week produced is congressional testimony, an FTC chairman's remark, six incident reports, two Altman posts and one tweet, and none of those is a contract, an insurance policy or a filed case [21]. Anyone drafting indemnity language for a model deployment is still guessing which layer a court will pick. The post's own conclusion is that AI liability probably needs to be "distributed across the stack, not consolidated at one layer" [17].
What to watch
- Whether any lab's standard terms add an indemnity or hold-harmless clause covering model behavior. A clause like that would move this from testimony into contract.
- Whether the antitrust waiver request reaches the FTC formally, and what Ferguson does with it after calling it an alarm bell.
- Whether OpenAI keeps publishing misalignment incident reports, and whether later ones identify the deployment layer where each behavior occurred.