Models › Olmo 3.1 32B › Apple M4 Pro (48 GB)
Can I run Olmo 3.1 32B on Apple M4 Pro (48 GB)?
Yes
Yes. Olmo 3.1 32B fits fully on the Apple M4 Pro (48 GB) at Q6_K (about 29.7 GB of 32 GB usable, 8k context). ESTIMATE
Verdict by quantization (8k context, f16 KV, 32 GB RAM for offload)
| Quant | Needs | Apple M4 Pro (48 GB) (48 GB, ~32 GB GPU-usable) |
|---|---|---|
| Q3_K_M | 18.9 GB | ✅ Fits |
| IQ4_XS | 19.9 GB | ✅ Fits |
| Q4_K_M | 22.5 GB | ✅ Fits |
| MXFP4 | 21.5 GB | ✅ Fits |
| Q5_K_M | 26.0 GB | ✅ Fits |
| Q6_K | 29.7 GB | ⚠️ Fits, tight |
| Q8_0 | 37.9 GB | ❌ Doesn't fit |
| F16 | 68.8 GB | ❌ Doesn't fit |
Speed ESTIMATE
About 10 tok/s generation at Q4_K_M, scaled from measured Llama 2 7B Q4_0 runs on this chip. Not measured for Olmo 3.1 32B; submit a benchmark.
Memory figures are estimates from the model's parameter count and config.json (Hugging Face). How we calculate. Last verified with data from 2026-10-22.
FAQ
Can I run Olmo 3.1 32B on the Apple M4 Pro (48 GB)?
Yes. Olmo 3.1 32B fits fully on the Apple M4 Pro (48 GB) at Q6_K (about 29.7 GB of 32 GB usable, 8k context).
How much VRAM does Olmo 3.1 32B need?
About 22.5 GB at Q4_K_M and 37.9 GB at Q8_0 with 8k context (estimate).
Other models on Apple M4 Pro (48 GB): gpt-oss 20B (MoE) · Qwen3.6 27B · Qwen3.6 35B A3B (MoE) · Qwen3.8 27B · Gemma 4 31B · Gemma 4 26B A4B (MoE) · Gemma 4 12B · Qwen3.5 9B · Qwen3 Coder 30B A3B (MoE) · GLM 4.7 Flash · Llama 3.1 8B Instruct · Kimi Linear 48B A3B (MoE) · NVIDIA Nemotron 3 Nano 30B A3B (MoE)
See all models for a 48GB Mac · all Mac sizes.
Won't fit? Free hosted options: FreeAISwap.
Will It Run? Pro NOT BUILT YET
A personal setup for your exact hardware (Ollama / llama.cpp configs ready for your coding agent), an alert when a new model fits, and a one-click cloud fallback when it doesn't.
Not built yet. Join the waitlist, $10/mo planned, no charge now. What's planned
Email only. No payment info.