build1 distinct publisher
Meta's MTIA 300 bets recommendation training is bottlenecked by the wire, not the math
Meta's new training chip treats collectives as the scarce resource and moves the network into the package. The design only pays off if embeddings, not FLOPs, set the pace.
Publishers:engineering.fb.com
Reality
- Evidence42
- Adoption34