HyperPod Inference Operator

HyperPod holds the inference deployment until every target node has cached the weights

Reading a 600 GB checkpoint from local NVMe at 7 GB/s takes about 86 seconds, so the network stops gating scale-out on warm nodes. The first fill still costs the full download. The slowest node sets it.