Skip to content

Product1 publisher3 min readPublished

Nandy will legislate device-level nudity blocking after Apple and Google's commitments fell short

The government spent three months getting Apple and Google to draft roadmaps for stopping children taking and sharing nude images on phones, then judged the commitments too small and reached for primary legislation instead.

The Product Desk · Product desk

Illustration accompanying Nandy will legislate device-level nudity blocking after Apple and Google's commitments fell short

What happened

  • In June the government gave industry three months to produce roadmaps for strengthening device-level protections, aimed at preventing children taking, sharing or viewing nude images on phones and tablets.
  • Both companies came back with operating-level changes, including progress on blocking rather than blurring nude imagery on devices identified as belonging to under-18s.
  • The government will now introduce primary legislation requiring major tech platforms to build in device-level protections for children, tabled as soon as it can.

Compiled by The Product DeskSomething wrong?How this is made

Why it matters

  • precedent Working the voluntary route bought Apple and Google no reprieve; the engineering they demonstrated is now the government's proof that the same protections can be mandated on everyone else.
  • decision Teams that treated child safety as an in-app moderation problem have to decide what their product does when the device refuses the action outright, and who answers the parent when it refuses wrongly.
  • constraint Anchoring the control to whether a device is classified as underage limits its reach to households where the age signal is correct, which leaves shared and hand-me-down hardware outside the protection.
  • exposure The announced duty falls on major tech platforms while the control lives in the operating system, so who is in scope depends on drafting nobody outside government has seen.

A blurred photo with a tap-through underneath it is a speed bump. The statement to the Commons makes the distinction the government now cares about: progress in the blocking, not the blurring, of nude imagery on underage devices [4]. Blurring leaves the image where it is and hands the child a choice. Blocking removes the choice, and removes it from the app that would otherwise have handled it.

The unit of enforcement there is the device, not the account and not the message. Apple's rollout earlier this year of operating-system level age assurance tied to safety features, which stops a child receiving or sharing nude imagery on iMessage or FaceTime [5], is the shape of the thing. For anyone shipping an app, that relocates the failure mode. It stops being a classifier that missed an image and becomes a device that believes the wrong thing about who is holding it. A shared tablet, or a hand-me-down phone still signed in to a parent's account, does not get safer because the operating system gained a new switch.

The three-month clock reads better as an evidence-gathering exercise than as a deadline. Industry was challenged in June [1], which put the roadmaps due around September [13]. Officials from Nandy's department and the Home Office spent that window working with Apple and Google's senior leaders and engineers [2] and came away with what the statement calls meaningful changes at the operating level [3]. Nandy then told the House the proposals were a step in the right direction but did not meet the scale of the crisis [6], said she was not prepared to give technology companies the benefit of the doubt on pace while harm is being done now [11], and committed to primary legislation requiring major tech platforms to build in device-level protections [7]. Cooperating proved the changes were buildable, which is exactly the argument a bill needs. The stated ambition, set out in December's Action Plan on Violence Against Women and Girls, is for the UK to be the first country where it is impossible for children to take, share or view nudity online [12].

The figures in the statement establish volume, not mechanism. The Internet Watch Foundation's estimate that 91% of these images are self-generated by children [8] is the load-bearing one, because it aims the intervention at the moment of capture rather than at distribution. Around 9,000 child sexual abuse offences a year involve an online element [9], roughly 25 a day [14], and under-18s are the subject of almost a quarter of online blackmail [10]. None of that says what share a device-level block would have prevented, and the statement does not claim it does.

For the person who has to roll this out, two questions cross: whether the product touches the camera or the photo library on a phone or tablet, and whether it relies on the operating system to say the user is a child. Depend on both and your child-safety roadmap is now Apple's and Google's, with your name on the support ticket. Read device media but run your own age checks, and you will eventually hold two different answers about the same user, so decide in advance which one wins. Run your own checks and stay off device media, and the open question is whether "major tech platforms" in the draft bill is written to include you [7]. Touch neither, and you still get the parent asking why the photo will not send.

Nandy accepted the commitments and legislated anyway [6][7]. That is the clearest available measure of how much shelter a voluntary roadmap buys.

What to watch

  • The bill text, and whether "major tech platforms" is drafted to catch operating systems and handset makers or only services.
  • Whether the duty rests on age signals the operating system already holds, or forces a separate age-assurance obligation onto app developers.
  • Publication of the Apple and Google roadmaps themselves, which the statement summarises rather than quotes.
Loading claim ledger
Loading source directory links
Loading share composer
Loading topic controls
Loading related stories