gpt-oss-120b

OpenAI · 120.4B (active 8B) · MoE · ctx 128K · Apache 2.0 · HuggingFace

gpt-oss-120b (OpenAI) is a 120.4B parameters MoE (8B active per token) open-weight model tracked on AI Hashrate. At 8K context we estimate roughly 68.82 GB VRAM for Q4 (weights 66.22 GB + KV 1.6 GB + 1 GB overhead) and 243.4 GB for FP16. About 10 GPUs/accelerators in our catalog fully fit this model at Q4 under that context assumption. Fastest Q4 configs: B200 192GB SXM ≈ 636.4 tok/s (estimated); MI300X 192GB ≈ 421.6 tok/s (estimated); H200 141GB SXM5 ≈ 381.8 tok/s (estimated); H100 80GB SXM5 ≈ 266.5 tok/s (estimated); Gaudi 3 128GB ≈ 260.6 tok/s (estimated). Use the table below for VRAM fit and tok/s per dollar (list MSRP). Estimates follow memory-bandwidth math; measured rows override when present. See methodology for details. Methodology.

33 hardware configs — sorted by tok/s. Default fit context 8K.