GLM-5.1 (Z.ai) is a 753.9B parameters MoE (40B active per token) open-weight model tracked on AI Hashrate. At 8K context we estimate roughly 423.65 GB VRAM for Q4 (weights 414.65 GB + KV 8.0 GB + 1 GB overhead) and 1516.8 GB for FP16. About 0 GPUs/accelerators in our catalog fully fit this model at Q4 under that context assumption. Fastest Q4 configs: B200 192GB SXM ≈ 74.7 tok/s (estimated); MI300X 192GB ≈ 49.5 tok/s (estimated); H200 141GB SXM5 ≈ 24.2 tok/s (estimated). Use the table below for VRAM fit and tok/s per dollar (list MSRP). Estimates follow memory-bandwidth math; measured rows override when present. See methodology for details. Methodology.
| Hardware | VRAM | Quant | tok/s | Fits? | tok/s/$ |
|---|---|---|---|---|---|
| B200 192GB SXM | 192 | Q4 | 74.7 est. | No | 0.002 |
| MI300X 192GB | 192 | Q4 | 49.5 est. | No | 0.003 |
| H200 141GB SXM5 | 141 | Q4 | 24.2 est. | No | 0.001 |
| Gaudi 3 128GB | 128 | Q4 | 13.6 est. | No | 0.001 |
| Mac Studio M2 Ultra 192GB | 192 | Q4 | 7.5 est. | No | 0.001 |
| MacBook Pro M4 Max 128GB | 128 | Q4 | 2.3 est. | No | 0.001 |
| MacBook Pro M3 Max 128GB | 128 | Q4 | 1.7 est. | No | 0.0 |