Skip to content

Topic

LLM hardware requirements

The memory, GPU and throughput a model or inference tool needs to run, and the distance between published minimums and what real workloads consume.

Current clusters