WebGPU

Llama-3 in the browser: the record stays put, but you ship 4 GB to every device

A WebLLM tutorial splits cheap entity extraction from expensive reasoning with no PHI on the wire. The architecture holds up; the first-load bill and the hardware gate are the parts to cost out.