Skip to content

Topic

Small-model memory budgets

Design work on language systems constrained to a fixed byte budget, where network weights, n-gram count tables and runtime caches compete for the same space and accuracy depends on how the bytes are divided.

Current clusters