Val Bercovici

China Merchants Bank's 60% token-cost cut outpaces the utilization gain it credits

The bank pooled nearly 10,000 heterogeneous accelerator cards under Kubernetes and reports average utilization rising from 35% to more than 60%. That density supplies 1.71 of the 2.5x drop in cost per million tokens.