← AI Hashrate 中文

Can MacBook Neo A18 Pro 8GB run NVIDIA-Nemotron-3-Super-120B-A12B-BF16?

Apple · 8 GB LPDDR5X · 60 GB/s bandwidth · NVIDIA · 120.0B (active 12.0B) · MoE · model ctx up to 256K

❌ No — NVIDIA-Nemotron-3-Super-120B-A12B-BF16 Q4 needs 68.54 GB, card only has 8 GB
VRAM: 68.54 GB needed of 8 GB
FF · No FitComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
METAL
Your GPU won't fit NVIDIA-Nemotron-3-Super-120B-A12B-BF16, but runs these similar models: Qwen2.5-7B-Instruct, gemma-4-E2B-itor☁️ Rent on RunPod from ~$0.50/hr
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K68.54 GBNo
Q48K default68.89 GBNo
Q432K70.95 GBNo
FP164K241.34 GBNo
FP168K default241.69 GBNo
FP1632K243.75 GBNo

Fits = weights + KV(ctx) + 0.5 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededMacBook Neo A18 Pro 8GB VRAM
Q467.2 GB0.69 GB0.5 GB68.89 GB8 GB
FP16240.0 GB0.69 GB0.5 GB241.69 GB8 GB

Other GPUs that run NVIDIA-Nemotron-3-Super-120B-A12B-BF16

All GPUs for NVIDIA-Nemotron-3-Super-120B-A12B-BF16 →

Other models for the MacBook Neo A18 Pro 8GB

All models on the MacBook Neo A18 Pro 8GB →