DGX Spark (GH200 480GB) vs MI300X 192GB for Local LLMs

The MI300X 192GB has about 960% more memory bandwidth (5,300 vs 500 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 960% faster on the MI300X 192GB. The DGX Spark (GH200 480GB) fits more of the catalog at Q4/8K — 66 vs 57 of 69 models (480 vs 192 GB VRAM). Largest model that fits the DGX Spark (GH200 480GB) but not the MI300X 192GB: DeepSeek-V4-Pro (861.6B). MSRP is $3,000 for the DGX Spark (GH200 480GB) vs $15,000 for the MI300X 192GB. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. Not retail-shoppable: MI300X 192GB (datacenter-class; cloud rental is the realistic way to use it). In the Q4/8K head-to-head below (69 shared models), the MI300X 192GB posts the higher tok/s in 69 rows vs 0. Methodology.

Spec comparison

	DGX Spark (GH200 480GB)	MI300X 192GB
Vendor	NVIDIA	AMD
VRAM	480 GB	192 GB
Memory type	LPDDR5X	HBM3
Memory bandwidth	500 GB/s	5,300 GB/s
TDP	170 W	750 W
MSRP (list)	$3,000	$15,000
Buy	Search Amazon (affiliate)	—

MSRP is the launch list price, not live retail. Buy links are Amazon affiliate links — the price after you click is the live price.

Q4 / 8K head-to-head — top 15 of 69 shared models

Model	Params (B)	DGX Spark (GH200 480GB) tok/s	DGX Spark (GH200 480GB) fits	MI300X 192GB tok/s	MI300X 192GB fits	Winner
MiniCPM5-1B	1.08	294.6 est.	Yes	3122.9 est.	Yes	MI300X 192GB
Qwen3.5-2B	2.0	159.1 est.	Yes	1686.4 est.	Yes	MI300X 192GB
DeepSeek-R1-0528-Qwen3-8B-layer-mix-bpw-3.8-mlx	2.3	138.3 est.	Yes	1466.4 est.	Yes	MI300X 192GB
Qwen3.6-35B-A3B	36.0	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
Qwen3.5-35B-A3B	34.7	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
GLM-4.7-Flash	31.2	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
Qwen3-30B-A3B-Instruct-2507	30.5	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16	30.0	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
Qwen3-Coder-Next	79.7	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
Ornith-1.0-35B	35.0	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
Qwen3-Next-80B-A3B-Instruct	81.3	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
qwen35b-a3b-fable-sft-abliterated	34.7	106.1 est.	Yes	1124.2 est.	Yes	MI300X 192GB
Llama-3.2-3B-Instruct	3.2	99.4 est.	Yes	1054.0 est.	Yes	MI300X 192GB
gpt-oss-20b	21.5	88.4 est.	Yes	936.9 est.	Yes	MI300X 192GB
gemma-4-26B-A4B-it	25.2	83.7 est.	Yes	887.6 est.	Yes	MI300X 192GB

est. = bandwidth-based estimate; measured = curated real benchmark that overrides the estimate. Fits = weights + KV(8K) + 1 GB overhead ≤ 95% of VRAM.

Fit coverage at Q4 / 8K

	DGX Spark (GH200 480GB)	MI300X 192GB
Catalog models that fit	66 of 69	57 of 69
Largest exclusive fit	DeepSeek-V4-Pro (861.6B)	—

DGX Spark (GH200 480GB) details → · MI300X 192GB details →