Invest1 publisher3 min readPublished
Klobuchar, Thune and Cruz would turn AI safety pledges into an enforceable duty of care
A researcher's resignation from Anthropic has produced real legislative momentum for binding federal AI rules. The bill now moving would make frontier developers answer in court for releases they failed to test.
The Investor · Invest desk

What happened
- Jacob Coxon resigned from Anthropic on September 8, 2026, and said publicly that the technology could wipe out humanity within a decade.
- More than 20 members of Congress have publicly called for stricter AI oversight in the days since that resignation.
- Amy Klobuchar, John Thune and Ted Cruz are advancing a bipartisan bill that would convert the industry's voluntary safety pledges into enforceable legal requirements for developers of powerful models.
- The core provisions are mandatory pre-release safety testing for advanced systems, independent third-party audits, and standardized reporting obligations for developers.
Compiled by The InvestorSomething wrong?How this is made
Why it matters
- exposure Anthropic's published doubts about its newer models' bioweapon potential become the sort of document a plaintiff opens with. A lab's candour about its own systems raises its evidentiary exposure.
- constraint A government power to stop a hazardous release puts a launch date on a reviewer's calendar. Any revenue booked against a ship date then depends on a decision the developer does not make.
- precedent Statutory testing and third-party audits make model evaluation a purchased service, and the auditors' capacity becomes a queue every developer has to join before shipping.
- contradiction The case for the rules rests on extinction estimates from researchers inside the company that would bear the duty. The loudest risk claims and the strongest incentive to soften the standard sit with the same party.
A duty of care has two moving parts: harm, and a failure to take reasonable precautions [5]. The first is decided after the fact by someone else. The second is decided against documents the developer wrote before release, and Anthropic has published a threat report raising doubts about whether its newer models could assist in developing biological weapons [10]. Under the standard the senators describe, that report is evidence of what the company knew.
So a lab that publishes candidly builds part of the record a plaintiff will use, and a lab that publishes less has less to explain. The description of the bill does not say whether completing the mandated tests would be a defence. That distinction sets the size of the number. With a safe harbour tied to the testing protocol, compliance is a fee for audits and reports [6]. Without one, it is an open tail that insurers will price slowly and expensively.
The more immediate cost is scheduling. Crypto Briefing reports that the bill would give the government authority to intervene and prevent the release of models deemed hazardous [7]. A launch date then becomes contingent on a review the developer does not run. Mandatory pre-release testing and independent third-party audits [6] also need auditors with capacity, and there is no queue today because there is no requirement today.
OpenAI has publicly advocated for mandatory national safety standards and testing protocols, a position it takes as a company that would be directly subject to the rules [8]. A lab already running internal evaluations pays less at the margin for a rule requiring them than a new entrant does. It also gets a federal answer to the question of what counts as enough. The other reading is that the position is sincere and costs OpenAI money.
The figure underneath all of this is a probability. Evan Hubinger, another Anthropic researcher, has publicly estimated a greater than 10% chance of an AI-driven extinction event within the next decade [9]; spread evenly across ten years, that is roughly a 1% chance a year [1]. Congress is legislating against an estimate produced inside a company the bill would regulate [4].
Passage is the weak link. Lawmakers have flagged the difficulty of writing technically sound rules for a technology that evolves faster than Congress can schedule hearings [11]. Some are reluctant to vote on a complex regulatory framework while running for re-election in November [12]. I would expect the pre-release review power to bind operators before the liability does, because a hold on a launch moves a revenue date this year while a duty of care is litigated over years. If the introduced text pairs the duty with a safe harbour for labs that complete the mandated tests, that expectation is wrong, and the whole thing prices as an audit fee.
What to watch
- Whether the introduced text sets a deadline for the government review that can block a release.
- Whether the audit provision specifies who accredits the third-party auditors developers would have to hire.
- Whether Anthropic keeps publishing threat reports about the safety of its own newer models.