build1 distinct publisher
Vortex streams 13 Gbit/s of columnar data from S3 into GPU memory without an NVMe hop
The figure comes from a conference demo scanning a 4K video, and the same talk sets a target closer to 50 Gbit/s. The reason today's loaders still stage shards on disk turns out to be PyTorch's worker model.
Publishers:infoq.com
Reality
- Evidence42
- Adoption
- Insufficient
- Hype gap+28
- Incentives72