In-Network Computing

Cornelis wants the network to finish the AllReduce before data reaches the GPU

Cornelis Networks launched a fabric that performs reductions and gradient compression in transit, and the only number attached to it, a traffic cut of up to 50%, comes from the company's own pre-production simulations.