Extreme Quantization

A 180M-parameter model on a $6 board says the microcontroller limit was active params, not total

p-for-llm puts a 29-expert, top-1-routed mixture of experts on an ESP32-P4 and got two points on Hacker News. The routing, not the quantization, is the load-bearing part.