← AI Hashrate 中文

Can B200 192GB SXM run MiMo-V2.5?

NVIDIA · 192 GB HBM3e · 8000 GB/s bandwidth · Xiaomi · 310.0B (active 15.0B) · MoE · model ctx up to 1024K

✅ Yes — B200 192GB SXM (192 GB) can run MiMo-V2.5 at Q4 (8K)
VRAM: 171.88 GB needed of 192 GB
Speed: ~339.4 tok/s (estimated)
BB · GoodComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
CUDA
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K171.69 GBYes339.4 ± est.
Q48K default171.88 GBYes339.4 ± est.
Q432K173.0 GBYes339.4 ± est.
FP164K621.19 GBNo25.5 ± est.
FP168K default621.38 GBNo25.5 ± est.
FP1632K622.5 GBNo25.4 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededB200 192GB SXM VRAM
Q4170.5 GB0.38 GB1 GB171.88 GB192 GB
FP16620.0 GB0.38 GB1 GB621.38 GB192 GB

Other GPUs that run MiMo-V2.5

All GPUs for MiMo-V2.5 →

Other models for the B200 192GB SXM

All models on the B200 192GB SXM →