Can MacBook Pro M4 Max 128GB run NVIDIA-Nemotron-3-Super-120B-A12B-BF16?
Apple · 128 GB LPDDR5X · 546 GB/s bandwidth ·
NVIDIA · 120.0B (active 12.0B) · MoE · model ctx up to 256K
Yes — the MacBook Pro M4 Max 128GB (128 GB LPDDR5X) can run NVIDIA-Nemotron-3-Super-120B-A12B-BF16. At Q4 with the default 8K context it needs ≈ 69.4 GB VRAM (weights 66.0 GB + KV cache 2.4 GB + 1 GB runtime overhead), which fits within 128 GB. Decode at Q4/8K: ≈ 29.0 tok/s (estimated, batch 1). FP16 needs ≈ 243.4 GB — does not fit on this card. Estimates come from memory-bandwidth math; rows tagged measured override estimates. Relative ranking is more reliable than absolute tok/s. Methodology.
Fit & speed by quant and context
Quant
Context
VRAM needed
Fits?
tok/s (decode)
Q4
4K
68.2 GB
Yes
29.0est.
Q4
8K default
69.4 GB
Yes
29.0est.
Q4
32K
76.6 GB
Yes
29.0est.
FP16
4K
242.2 GB
No
6.4est.
FP16
8K default
243.4 GB
No
6.3est.
FP16
32K
250.6 GB
No
5.9est.
Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured
anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s
means the model is far beyond this card (offload-only territory).
VRAM breakdown at 8K context
Quant
Weights
KV cache
Overhead
Total needed
MacBook Pro M4 Max 128GB VRAM
Q4
66.0 GB
2.4 GB
1 GB
69.4 GB
128 GB
FP16
240.0 GB
2.4 GB
1 GB
243.4 GB
128 GB
Other GPUs that run NVIDIA-Nemotron-3-Super-120B-A12B-BF16