Skip to content

other

RMSNorm

A normalisation layer used in modern transformers that rescales activations by their root-mean-square without centring them.

Known aliases

  • root mean square normalization

Relationships

No evidence-backed relationships are recorded.

Current clusters