SageMaker Inference Components

One SchedulingConfig parameter puts Salesforce's shared-GPU model copies in both Availability Zones

Co-hosting models on shared GPUs cut Salesforce's inference infrastructure bill eightfold, but the placement algorithm that made it cheap counted instances and ignored Availability Zones. SchedulingConfig reconciles the two.