Short answers

Each page answers one question up top, then shows the numbers behind it. Memory figures are estimates from our fit math.

• What LLM can I run on my GPU?
• How much VRAM do I need for a 70B model?
• Is 16GB RAM enough to run an LLM locally?
• MLX vs GGUF on a Mac: which is faster?
• How much VRAM do I need for a 7B model?
• How much VRAM do I need for a 32B model?
• Is 12GB VRAM enough for local LLMs?
• How much VRAM does context length use?
• Can you run an LLM on CPU only?
• Q4 vs Q8: which quantization should I use?