build1 distinct publisher
One SchedulingConfig parameter puts Salesforce's shared-GPU model copies in both Availability Zones
Co-hosting models on shared GPUs cut Salesforce's inference infrastructure bill eightfold, but the placement algorithm that made it cheap counted instances and ignored Availability Zones. SchedulingConfig reconciles the two.
Publishers:aws.amazon.com
Reality
- Evidence58
- Adoption45
- Hype gap+18
- Incentives82