Models › Llama 4 Scout 17B 16E (MoE) › Apple M3 Ultra (96 GB)
Can I run Llama 4 Scout 17B 16E (MoE) on Apple M3 Ultra (96 GB)?
Yes
Yes. Llama 4 Scout 17B 16E (MoE) fits fully on the Apple M3 Ultra (96 GB) at Q4_K_M (about 70.5 GB of 72 GB usable, 8k context). ESTIMATE
Verdict by quantization (8k context, f16 KV, 32 GB RAM for offload)
| Quant | Needs | Apple M3 Ultra (96 GB) (96 GB, ~72 GB GPU-usable) |
|---|---|---|
| Q3_K_M | 58.9 GB | ✅ Fits |
| IQ4_XS | 62.3 GB | ✅ Fits |
| Q4_K_M | 70.5 GB | ⚠️ Fits, tight |
| MXFP4 | 67.5 GB | ⚠️ Fits, tight |
| Q5_K_M | 81.9 GB | ❌ Doesn't fit |
| Q6_K | 93.7 GB | ❌ Doesn't fit |
| Q8_0 | 120.0 GB | ❌ Doesn't fit |
| F16 | 221.9 GB | ❌ Doesn't fit |
Speed
No measured run for this pair yet, and we don't estimate MoE speeds. Submit a llama-bench run.
Memory figures are estimates from the model's parameter count and config.json (Hugging Face). How we calculate. Last verified with data from 2026-10-22.
FAQ
Can I run Llama 4 Scout 17B 16E (MoE) on the Apple M3 Ultra (96 GB)?
Yes. Llama 4 Scout 17B 16E (MoE) fits fully on the Apple M3 Ultra (96 GB) at Q4_K_M (about 70.5 GB of 72 GB usable, 8k context).
How much VRAM does Llama 4 Scout 17B 16E (MoE) need?
About 70.5 GB at Q4_K_M and 120.0 GB at Q8_0 with 8k context (estimate).
Other models on Apple M3 Ultra (96 GB): GLM 4.5 Air (MoE) · Qwen3 Coder Next (MoE) · Llama 3.3 70B Instruct
See all models for a 96GB Mac · all Mac sizes.
Won't fit? Free hosted options: FreeAISwap.
Will It Run? Pro NOT BUILT YET
A personal setup for your exact hardware (Ollama / llama.cpp configs ready for your coding agent), an alert when a new model fits, and a one-click cloud fallback when it doesn't.
Not built yet. Join the waitlist, $10/mo planned, no charge now. What's planned
Email only. No payment info.