build1 publisher
A recurrent block unrolls a 3.5B model into a 50B-parameter compute bill
Geiping's Huginn improves on reasoning benchmarks by looping a latent block instead of emitting chain-of-thought tokens, holding weights at 3.5 billion while per-token compute rises about fourteenfold.
Publishers:arxiv.org
Reality
- Evidence45
- Adoption10
- Hype gap+20
- Incentives55