← AI Hashrate

B200 192GB SXM vs MI300X 192GB for Local LLMs

The B200 192GB SXM has about 51% more memory bandwidth (8,000 vs 5,300 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 51% faster on the B200 192GB SXM. Both fit the same number of catalog models at Q4/8K (50 of 61; 192 vs 192 GB VRAM). MSRP is $40,000 for the B200 192GB SXM vs $15,000 for the MI300X 192GB. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. Not retail-shoppable: B200 192GB SXM, MI300X 192GB (datacenter-class; cloud rental is the realistic way to use it). In the Q4/8K head-to-head below (61 shared models), the B200 192GB SXM posts the higher tok/s in 61 rows vs 0. Methodology.

Spec comparison

B200 192GB SXMMI300X 192GB
VendorNVIDIAAMD
VRAM192 GB192 GB
Memory typeHBM3eHBM3
Memory bandwidth8,000 GB/s5,300 GB/s
TDP1000 W750 W
MSRP (list)$40,000$15,000
Buy——

MSRP is the launch list price, not live retail. Buy links are Amazon affiliate links — the price after you click is the live price.

Q4 / 8K head-to-head — top 15 of 61 shared models

ModelParams (B)B200 192GB SXM tok/sB200 192GB SXM fitsMI300X 192GB tok/sMI300X 192GB fitsWinner
gemma-3-1b-it1.05000 est.Yes3372.7 est.YesB200 192GB SXM
Qwen3-0.6B0.85000 est.Yes4215.9 est.YesB200 192GB SXM
Llama-3.2-1B-Instruct1.24242.4 est.Yes2810.6 est.YesB200 192GB SXM
Qwen3-1.7B2.02545.5 est.Yes1686.4 est.YesB200 192GB SXM
Qwen3-30B-A3B30.51697.0 est.Yes1124.2 est.YesB200 192GB SXM
Qwen3-Coder-30B-A3B-Instruct30.51697.0 est.Yes1124.2 est.YesB200 192GB SXM
GLM-4.7-Flash31.21697.0 est.Yes1124.2 est.YesB200 192GB SXM
Qwen3-30B-A3B-Instruct-250730.51697.0 est.Yes1124.2 est.YesB200 192GB SXM
Qwen3-Next-80B-A3B-Instruct81.31697.0 est.Yes1124.2 est.YesB200 192GB SXM
Qwen3-Coder-Next79.71697.0 est.Yes1124.2 est.YesB200 192GB SXM
Llama-3.2-3B-Instruct3.21590.9 est.Yes1054.0 est.YesB200 192GB SXM
gpt-oss-20b21.51414.1 est.Yes936.9 est.YesB200 192GB SXM
Phi-4-mini-instruct3.81339.7 est.Yes887.6 est.YesB200 192GB SXM
Phi-4-mini-reasoning3.81339.7 est.Yes887.6 est.YesB200 192GB SXM
gemma-3-4b-it4.31305.4 est.Yes864.8 est.YesB200 192GB SXM

est. = bandwidth-based estimate; measured = curated real benchmark that overrides the estimate. Fits = weights + KV(8K) + 1 GB overhead ≤ 95% of VRAM.

Fit coverage at Q4 / 8K

B200 192GB SXMMI300X 192GB
Catalog models that fit50 of 6150 of 61
Largest exclusive fit——

B200 192GB SXM details → · MI300X 192GB details →