Inference Cold Starts and Tail Latency

Bin-packing is the wrong scoreboard when a 70B checkpoint costs minutes

CoreWeave's product SVP says agentic workloads break the three assumptions cloud schedulers rest on. The worked example in the write-up bills 14.8 GPU-seconds to use 4.2.