Build1 publisher3 min readPublished
British Columbia asks a California court to write OpenAI's escalation policy
The province wants damages for its recovery from the Tumbler Ridge shooting and an order changing how OpenAI handles conversations that could lead to violence. Its case starts with a flag raised in June 2025.
The Engineer · Build desk

What happened
- British Columbia sued OpenAI in California on Monday, alleging the Tumbler Ridge school shooting could have been prevented had the company warned local police that the shooter used ChatGPT to plan it.
- Nine people, primarily children, were killed in the shooting, and the province says the company's safety team had flagged the shooter's conversations about gun violence without alerting police.
- More than 30 family members and others affected have already sued in California federal court, accusing the company of opting out of a chance to prevent the shooting.
Compiled by The EngineerSomething wrong?How this is made
Why it matters
- contradiction OpenAI says it notifies law enforcement on an imminent and credible risk of harm to others, and it also said this account did not meet its internal criteria, so the dispute is over where the threshold sits and who gets to set it.
- decision An order specifying how violence-adjacent conversations are handled would move escalation thresholds and routing into the release spec, reviewed by counsel before ship.
- constraint Banning an account stops nothing unless re-registration can be tied to the same person, and that requires keeping and matching signup identifiers across attempts.
- exposure A provincial treasury claiming a demolished school, a replacement building and mental health care sets a damages base well above what any single family can claim.
The classifier fired. After the Wall Street Journal reported on the case, OpenAI said the account had been flagged by systems that identify "misuses of our models in furtherance of violent activities," and that the issues did not meet its internal criteria for reporting to law enforcement [14].
Two decisions sat downstream of that flag. Both were policy. The first is the threshold: OpenAI has said it notifies law enforcement when conversations suggest "an imminent and credible risk of harm to others" [16]. The province's complaint, citing OpenAI whistleblowers who spoke to the Journal, says safety team members recommended contacting police and that Sam Altman and other leadership overruled them [12].
The second is enforcement scope. The shooter's account was deactivated, and she obtained a new account and kept using the platform to plan the attack [13]. Deactivation is a credential-level control. Making it person-level means retaining identifiers from the first signup, matching them against later ones, and absorbing the lockouts that follow when the match is wrong. None of that appears in a model card.
The flag is dated June 2025 [12]. Police say the attack happened on February 10, when Jesse Van Rootselaar shot her mother and stepbrother at home before killing an educational assistant and five students aged 12 to 13 at her former school [11]. The earliest February that can follow a June 2025 flag is February 2026, so at least eight months separate the two events [18].
British Columbia is seeking damages for what it has spent and will spend on recovery, plus an order directing changes to the way the company handles ChatGPT conversations that could lead to violence [3]. An order like that has to be written in specifics: which classifier outputs escalate, to whom, on what clock, and whether a banned user's re-registration counts as continuing knowledge. The province filed in federal court in San Francisco, naming OpenAI and Altman as defendants [2].
Its damages claim reaches past wrongful death. The lawsuit counts the demolition of the school, the replacement building, and mental health care the province has absorbed [7]. More than 30 family members of victims and others affected have filed their own suits in California federal court, accusing the company of opting out of a chance to prevent the shooting [10]. Florida sued OpenAI in June, accusing it of misrepresenting ChatGPT's safety and of harming children by providing information to school shooters [15]. OpenAI has denied the claims [16].
Drew Pusateri, a spokesperson for OpenAI, called the Tumbler Ridge shooting an unspeakable tragedy [8]. "OpenAI remains committed to working collaboratively with government and law enforcement officials, and continuing to advance our ongoing safety work," Pusateri said [9]. Altman published a letter to the community saying he was "deeply sorry" OpenAI had not contacted law enforcement, and the lawsuit says he promised reforms and never followed through, despite efforts by British Columbia's attorney general to engage [6].
For this to become a build requirement elsewhere, a vendor has to be in the same position OpenAI was: conversations retained, a violence classifier scoring them, and a human queue behind the score. A duty to warn reaches only the vendors that kept something to warn from. The report does not say what OpenAI's internal reporting criteria require [19].
What to watch
- Whether the province's claims survive a motion to dismiss in federal court in San Francisco, given that the duty it asserts runs to police in another country.
- Whether OpenAI publishes or revises the internal reporting criteria it says the flagged conversations did not meet.
- Consolidation of the family suits with the province's case, which would put one escalation record before a single judge.