CheckerWhat fits my GPU?ModelsWhat to buyEmbeddingsData & methodSubmitAPISponsor

Models › NVIDIA Nemotron 3 Super 120B A12B (MoE) › Apple M4 Max (128 GB)

Can I run NVIDIA Nemotron 3 Super 120B A12B (MoE) on Apple M4 Max (128 GB)?

Yes

Yes. NVIDIA Nemotron 3 Super 120B A12B (MoE) fits fully on the Apple M4 Max (128 GB) at Q5_K_M (about 91.0 GB of 96 GB usable, 8k context). ESTIMATE

Verdict by quantization (8k context, f16 KV, 32 GB RAM for offload)

QuantNeedsApple M4 Max (128 GB) (128 GB, ~96 GB GPU-usable)
Q3_K_M64.9 GB✅ Fits
IQ4_XS68.7 GB✅ Fits
Q4_K_M78.0 GB✅ Fits
MXFP474.6 GB✅ Fits
Q5_K_M91.0 GB⚠️ Fits, tight
Q6_K104.4 GB❌ Doesn't fit
Q8_0134.4 GB❌ Doesn't fit
F16250.3 GB❌ Doesn't fit

Speed

No measured run for this pair yet, and we don't estimate MoE speeds. Submit a llama-bench run.

Memory figures are estimates from the model's parameter count and config.json (Hugging Face). How we calculate. Last verified with data from 2026-10-22.

FAQ

Can I run NVIDIA Nemotron 3 Super 120B A12B (MoE) on the Apple M4 Max (128 GB)?

Yes. NVIDIA Nemotron 3 Super 120B A12B (MoE) fits fully on the Apple M4 Max (128 GB) at Q5_K_M (about 91.0 GB of 96 GB usable, 8k context).

How much VRAM does NVIDIA Nemotron 3 Super 120B A12B (MoE) need?

About 78.0 GB at Q4_K_M and 134.4 GB at Q8_0 with 8k context (estimate).

Other models on Apple M4 Max (128 GB): gpt-oss 20B (MoE) · gpt oss 120b (MoE) · Qwen3.6 27B · Qwen3.6 35B A3B (MoE) · Qwen3.8 27B · Gemma 4 31B · Gemma 4 26B A4B (MoE) · Qwen3 Coder 30B A3B (MoE) · GLM 4.7 Flash · Llama 3.1 8B Instruct · Llama 3.3 70B Instruct · GLM 4.5 Air (MoE) · Mistral Medium 3.5 128B · Ornith 1.5 122B (MoE)

See all models for a 128GB Mac · all Mac sizes.

Won't fit? Free hosted options: FreeAISwap.

Will It Run? Pro NOT BUILT YET

A personal setup for your exact hardware (Ollama / llama.cpp configs ready for your coding agent), an alert when a new model fits, and a one-click cloud fallback when it doesn't.

Not built yet. Join the waitlist, $10/mo planned, no charge now. What's planned

Email only. No payment info.