CUDA Virtual Memory Management API

Shadow engines cut LLM restart from 283 seconds to 7.3, and change what headroom is for

NVIDIA Dynamo keeps a pre-warmed engine on the same GPUs and hands it the resident weights instead of reloading them. The measured recovery window falls to about 2.6% of a cold restart.