Yes — the DGX Spark (GH200 480GB) (480 GB LPDDR5X) can run AI21-Jamba-Large-1.5. At Q4 with the default 8K context it needs ≈ 299.95 GB VRAM (weights 219.23 GB + KV cache 79.72 GB + 1 GB runtime overhead), which fits within 480 GB. Decode at Q4/8K: ≈ 0.8 tok/s (estimated, batch 1). FP16 needs ≈ 877.92 GB — does not fit on this card. Estimates come from memory-bandwidth math; rows tagged measured override estimates. Relative ranking is more reliable than absolute tok/s. Methodology. Buy DGX Spark (GH200 480GB) on Amazon →
Fit & speed by quant and context
Quant
Context
VRAM needed
Fits?
tok/s (decode)
Q4
4K
260.09 GB
Yes
0.8±est.
Q4
8K default
299.95 GB
Yes
0.8±est.
Q4
32K
539.11 GB
No
1.8±est.
FP16
4K
838.06 GB
No
0.2±est.
FP16
8K default
877.92 GB
No
0.2±est.
FP16
32K
1117.08 GB
No
0.1±est.
Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).
VRAM breakdown at 8K context
Quant
Weights
KV cache
Overhead
Total needed
DGX Spark (GH200 480GB) VRAM
Q4
219.23 GB
79.72 GB
1 GB
299.95 GB
480 GB
FP16
797.2 GB
79.72 GB
1 GB
877.92 GB
480 GB
Other GPUs that run AI21-Jamba-Large-1.5
No catalog GPU fully fits AI21-Jamba-Large-1.5 at Q4/8K — see the model page for offload estimates. model page