AI inference cold start

GKE Pod snapshots skip large-model loading as long as the node's driver and kernel match

Google says GKE Pod snapshots, which restore saved CPU and GPU memory, cut startup latency by up to 89% and load a 70B model in 37 seconds. When a snapshot stops matching its node, the Pod starts cold with no error, so teams must keep snapshots valid across upgrades.