← AI Hashrate 中文

Can H100 80GB SXM5 run Qwen3-Coder-Next?

NVIDIA · 80 GB HBM3 · 3350 GB/s bandwidth · Alibaba · 79.7B (active 3B) · MoE · model ctx up to 256K

✅ Yes — H100 80GB SXM5 (80 GB) can run Qwen3-Coder-Next at Q4 (8K)
VRAM: 44.91 GB needed of 80 GB
Speed: ~710.6 tok/s (estimated)
AA · GreatComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
CUDA
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K44.87 GBYes710.6 ± est.
Q48K default44.91 GBYes710.6 ± est.
Q432K45.14 GBYes710.6 ± est.
FP164K160.44 GBNo138.7 ± est.
FP168K default160.47 GBNo138.7 ± est.
FP1632K160.7 GBNo138.3 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededH100 80GB SXM5 VRAM
Q443.84 GB0.08 GB1 GB44.91 GB80 GB
FP16159.4 GB0.08 GB1 GB160.47 GB80 GB

Other GPUs that run Qwen3-Coder-Next

All GPUs for Qwen3-Coder-Next →

Other models for the H100 80GB SXM5

All models on the H100 80GB SXM5 →