Gaudi 3 128GB

Intel · 128 GB HBM2e · 3276 GB/s · 600 W · MSRP $12,500

The Gaudi 3 128GB is a Intel accelerator with 128 GB HBM2e and about 3276 GB/s peak memory bandwidth. AI Hashrate estimates local LLM decode (batch 1) at 8K context: fit counts weights + KV cache + 1 GB runtime overhead — not weights alone. At Q4, about 47 curated models fit fully on this card; at FP16, about 38 fit. Top Q4 speeds: Qwen3-0.6B ≈ 2605.9 tok/s (estimated, fits); gemma-3-1b-it ≈ 2084.7 tok/s (estimated, fits); Llama-3.2-1B-Instruct ≈ 1737.3 tok/s (estimated, fits); Qwen3-1.7B ≈ 1042.4 tok/s (estimated, fits); Qwen3-30B-A3B ≈ 694.9 tok/s (estimated, fits). Relative ranking is more reliable than absolute tok/s. See methodology for the bandwidth formula and measured-anchor policy. Methodology.

Table: decode speed estimates (Q4 / FP16). Measured rows override estimates. MSRP is list price, not live retail. Context default 8K.