← AI Hashrate 中文

Can H200 141GB SXM5 run Solar Open 2?

NVIDIA · 141 GB HBM3e · 4800 GB/s bandwidth · Upstage · 250.0B (active 15.0B) · MoE · model ctx up to 1024K

✅ Yes — H200 141GB SXM5 (141 GB) can run Solar Open 2 at Q4 (8K)
VRAM: 138.88 GB needed of 141 GB
Speed: ~306.2 tok/s (estimated)
TT · Tight FitComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
CUDA
Tight fit — try smaller model or shorter contextTight fit — try smaller model or shorter contextTight fit — try smaller model or shorter context
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K138.69 GBTight306.2 ± est.
Q48K default138.88 GBTight306.2 ± est.
Q432K140.0 GBTight306.2 ± est.
FP164K501.19 GBNo12.7 ± est.
FP168K default501.38 GBNo12.6 ± est.
FP1632K502.5 GBNo12.6 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededH200 141GB SXM5 VRAM
Q4137.5 GB0.38 GB1 GB138.88 GB141 GB
FP16500.0 GB0.38 GB1 GB501.38 GB141 GB

Other GPUs that run Solar Open 2

All GPUs for Solar Open 2 →

Other models for the H200 141GB SXM5

All models on the H200 141GB SXM5 →