← AI Hashrate 中文

Can Tesla P4 8GB run gemma-3-27b-it?

NVIDIA · 8 GB GDDR5 · 192 GB/s bandwidth · Google · 27.4B · model ctx up to 128K

❌ No — gemma-3-27b-it Q4 needs 19.08 GB, card only has 8 GB
VRAM: 19.08 GB needed of 8 GB
Speed: ~1.7 tok/s (estimated)
FF · No FitComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
CUDA
Your GPU won't fit gemma-3-27b-it, but runs these similar models: Qwen3-8B, Qwen2.5-7B-Instructor☁️ Rent on RunPod from ~$0.50/hr
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K19.08 GBNo2.2 ± est.
Q48K default21.82 GBNo1.7 ± est.
Q432K38.26 GBNo
FP164K58.54 GBNo
FP168K default61.28 GBNo
FP1632K77.72 GBNo

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededTesla P4 8GB VRAM
Q415.34 GB5.48 GB1 GB21.82 GB8 GB
FP1654.8 GB5.48 GB1 GB61.28 GB8 GB

Other GPUs that run gemma-3-27b-it

All GPUs for gemma-3-27b-it →

Other models for the Tesla P4 8GB

All models on the Tesla P4 8GB →