Recurrent-depth architectures

A recurrent block unrolls a 3.5B model into a 50B-parameter compute bill

Geiping's Huginn improves on reasoning benchmarks by looping a latent block instead of emitting chain-of-thought tokens, holding weights at 3.5 billion while per-token compute rises about fourteenfold.