Graph compilation

vLLM measured its portability layer at 3.4 percent below native throughput on an H100

PyTorch says vLLM's frontier models now ship as hardware-specific flat definitions that torch.compile cannot trace, and the new HW agnostic layers are what users on other accelerators get instead. The overhead figure came from an H100.