← AI Hashrate 中文

Can H200 141GB SXM5 run Laguna S 2.1?

NVIDIA · 141 GB HBM3e · 4800 GB/s bandwidth · Poolside · 118.0B (active 8.0B) · MoE · model ctx up to 1024K

✅ Yes — H200 141GB SXM5 (141 GB) can run Laguna S 2.1 at Q4 (8K)
VRAM: 67.4 GB needed of 141 GB
Speed: ~574.0 tok/s (estimated)
AA · GreatComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
CUDA
Excellent for 💬 chatExcellent for ⌨️ codingExcellent for 📋 general
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K66.65 GBYes574.0 ± est.
Q48K default67.4 GBYes574.0 ± est.
Q432K71.9 GBYes574.0 ± est.
FP164K237.75 GBNo105.5 ± est.
FP168K default238.5 GBNo104.8 ± est.
FP1632K243.0 GBNo101.0 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededH200 141GB SXM5 VRAM
Q464.9 GB1.5 GB1 GB67.4 GB141 GB
FP16236.0 GB1.5 GB1 GB238.5 GB141 GB

Other GPUs that run Laguna S 2.1

All GPUs for Laguna S 2.1 →

Other models for the H200 141GB SXM5

All models on the H200 141GB SXM5 →