Skip to content

Build1 publisher2 min readPublished

The Sanders-Casar ban bill triggers on capability to overpower the federal government

Bernie Sanders and Greg Casar want a federal ban on developing AI capable of overpowering the federal government. ControlAI, which says it advised their offices, argues the bill's mandatory pause on advanced AI is unnecessary.

The Engineer · Build desk

Photograph accompanying The Sanders-Casar ban bill triggers on capability to overpower the federal government
Photo: abcnews.com

What happened

  • Senator Bernie Sanders and Representative Greg Casar introduced the Ban Artificial Superintelligence Act, which ControlAI calls the first American bill proposing to ban the development of superintelligent AI.
  • ControlAI, which says it consulted the sponsors' offices, disagrees with the bill on its proposed mandatory pause on advanced AI development and on its treatment of precursors.
  • ControlAI's own U.K. bill, which uses the same capability definition, was introduced in Parliament by Alex Sobel MP.

Compiled by The EngineerSomething wrong?How this is made

Why it matters

  • constraint A trigger written as a capability gives a compliance team nothing to instrument. Whether a training program is lawful turns on who assesses the system's power over the federal government, and at what stage.
  • contradiction The group that says it helped shape the framework is arguing against the clause with the widest reach over ordinary model training, so the bill's closest ally and its sponsors are not aligned on scope.
  • exposure A pause on advanced AI development reaches developers who would never claim to be building superintelligence, and the bill's own definition describes a different class of system entirely.
  • precedent With a U.S. bill and a U.K. bill built on the same capability test, that definition is now available for other legislatures to copy without resolving any technical threshold.

A capability trigger and a compute threshold are two different compliance objects. ControlAI, the advocacy group that says it consulted with the sponsors' offices on the legislative framework [9], describes the bill's definition as turning on an AI system's capability to overpower the federal government [4]. The group's stated reason for liking that construction is that it targets development posing an extinction risk without settling in advance the technical details of how such an AI would work [5]. It also, ControlAI wrote, "keeps measures focused on the types of AI development that threaten the federal government, even if AI companies change the label they use to describe those projects" [6].

A definition like that leaves an engineering organisation without a counter to read. A FLOP budget emits a number you can log and cap. A capability to overpower a government is an assessment, and the statute's practical scope depends on who makes it and at what point in a training program.

The clause that would reach ordinary frontier work is a separate one. ControlAI's two disagreements with the bill are its proposed mandatory pause on advanced AI development and its treatment of precursors to superintelligent AI [10]. "We believe that the proposal's goals can be achieved with a more targeted approach, like the one in our draft bill," the group wrote [11]. Two parameters decide whether that pause touches a given run: what triggers it, and how long it holds. ControlAI's post does not include the bill's text or a bill number [15].

The bill also requires the United States to pursue international agreements to ban superintelligent AI development [7]. ControlAI, which supports the provision, discounts its force: it "is unlikely to bind the executive branch, since Presidents have long treated congressional directions on the conduct of foreign policy as advisory, and the question has never been settled in court," the group wrote [8].

This is still a bill, and the post reports nothing about committee referral, cosponsors or floor time. It does document a distribution channel. ControlAI says it has briefed more than 400 lawmakers across the United States, the United Kingdom, Canada and Germany in the last two years [2], which works out to more than 16 briefings a month on average [1]. Its UK bill was introduced in Parliament by Alex Sobel MP [3]. The group says it uses the same capability-to-overpower definition in both its U.S. draft bill and its U.K. bill [12].

What to watch

  • The bill's operative text: what capability or scale triggers the mandatory pause on advanced AI development, and for how long.
  • Whether ControlAI's narrower U.S. discussion draft is introduced as a competing vehicle rather than left as a comment on this one.
  • Whether any cosponsors join an independent senator and a House Democrat on a prohibition bill.
Loading claim ledger
Loading source directory links
Loading share composer
Loading topic controls
Loading related stories