Inference memory footprint

A lone 50.0 activation coarsens the INT8 grid 62-fold for every other value in the tensor

Absmax INT8 takes one scale from the largest magnitude in a tensor, so a single outlier sets the step size for everything else. The LLM.int8() authors found those outliers sitting in about six feature dimensions.