Torch-TensorRT

Dynamo-Triton 26.07 puts eight GPU ranks behind a single named model endpoint

NVIDIA's TensorRT backend now creates per-rank contexts and NCCL communicators inside one Triton instance, and the client sends a single gRPC request to a model name. The GPU count is fixed at compile time.