H200 141GB SXM5 vs RTX 6000 Ada 48GB for Local LLMs
The H200 141GB SXM5 has about 400% more memory bandwidth (4,800 vs 960 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 400% faster on the H200 141GB SXM5. The H200 141GB SXM5 fits more of the catalog at Q4/8K — 48 vs 39 of 61 models (141 vs 48 GB VRAM). Largest model that fits the H200 141GB SXM5 but not the RTX 6000 Ada 48GB: MiniMax-M2.7 (228.7B). MSRP is $35,000 for the H200 141GB SXM5 vs $6,800 for the RTX 6000 Ada 48GB. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. Not retail-shoppable: H200 141GB SXM5 (datacenter-class; cloud rental is the realistic way to use it). In the Q4/8K head-to-head below (50 shared models), the H200 141GB SXM5 posts the higher tok/s in 50 rows vs 0. Methodology.