RTX 4080 Super 16GB vs V100 16GB PCIe for Local LLMs
The V100 16GB PCIe has about 22% more memory bandwidth (900 vs 736 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 22% faster on the V100 16GB PCIe. Both fit the same number of catalog models at Q4/8K (25 of 73; 16 vs 16 GB VRAM). MSRP is $999 for the RTX 4080 Super 16GB vs $8,000 for the V100 16GB PCIe. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. Not retail-shoppable: V100 16GB PCIe (datacenter-class; cloud rental is the realistic way to use it). In the Q4/8K head-to-head below (49 shared models), the V100 16GB PCIe posts the higher tok/s in 49 rows vs 0. Methodology.