Topic

LLM compression

Techniques for cutting the size and inference cost of large language models, including pruning, quantization, low-rank factorization and knowledge distillation.

Current clusters

build2 publishers

Multiverse's block-pruning method widens its MMLU lead over block-influence pruning as compression grows, reaching 22.9 points at 50%

Multiverse Computing ranks candidate prunings by the energy of an Ising glass, so a single GPU scored about 29 billion combinations in two days. The paper reports the older per-block heuristics do just as well at lighter compression.

Publishers:huggingface.coruntimewire.com

Reality

Evidence54
Adoption14
Hype gap+29
Incentives74
Confidence61