Model quantisation

llama.cpp's -ngl flag keeps a 9B model on a 6GB card by leaving 28 layers on the CPU

Every local runner now reads the same GGUF file, so the binding decision is the quant tag and the gigabyte or two of context that has to fit beside it. Ollama sets the GPU offload itself; llama.cpp lets you set it.