Models › GLM 4.7 Flash › RTX 3060 12GB
Can I run GLM 4.7 Flash on RTX 3060 12GB?
With offload
Only with RAM offload. At Q4_K_M it needs about 20.9 GB, more than the 12 GB usable on the RTX 3060 12GB; with 32 GB system RAM, llama.cpp can split layers (MoE experts to RAM), at a speed cost. ESTIMATE
Verdict by quantization (8k context, f16 KV, 32 GB RAM for offload)
| Quant | Needs | RTX 3060 12GB (12 GB) |
|---|---|---|
| Q3_K_M | 17.4 GB | 🐢 Needs RAM offload |
| IQ4_XS | 18.5 GB | 🐢 Needs RAM offload |
| Q4_K_M | 20.9 GB | 🐢 Needs RAM offload |
| MXFP4 | 20.0 GB | 🐢 Needs RAM offload |
| Q5_K_M | 24.4 GB | 🐢 Needs RAM offload |
| Q6_K | 27.9 GB | 🐢 Needs RAM offload |
| Q8_0 | 35.9 GB | 🐢 Needs RAM offload |
| F16 | 65.9 GB | ❌ Doesn't fit |
Speed
No measured run for this pair yet, and we don't estimate MoE speeds. Submit a llama-bench run.
Memory figures are estimates from the model's parameter count and config.json (Hugging Face). How we calculate. Last verified with data from 2026-10-20.
FAQ
Can I run GLM 4.7 Flash on the RTX 3060 12GB?
Only with RAM offload. At Q4_K_M it needs about 20.9 GB, more than the 12 GB usable on the RTX 3060 12GB; with 32 GB system RAM, llama.cpp can split layers (MoE experts to RAM), at a speed cost.
How much VRAM does GLM 4.7 Flash need?
About 20.9 GB at Q4_K_M and 35.9 GB at Q8_0 with 8k context (estimate).
GLM 4.7 Flash on other hardware: RTX 3090 · RTX 5090 · Apple M4 Pro (48 GB) · Apple M4 Max (128 GB)
Other models on RTX 3060 12GB: gpt-oss 20B (MoE) · Qwen3.6 27B · Qwen3.6 35B A3B (MoE) · Qwen3.8 27B · Gemma 4 31B · Gemma 4 26B A4B (MoE) · Gemma 4 12B · Qwen3.5 9B · Qwen3 Coder 30B A3B (MoE) · Llama 3.1 8B Instruct
See all models for 12 GB VRAM.
Won't fit? Free hosted options: FreeAISwap.