Self-host an open model
Self-host DeepSeek V4 Flash: GPU, VRAM, and rental cost
Self-hosting DeepSeek V4 Flash (290.9B, 13B active) in FP8 needs about 388 GB of VRAM per GPU at 8K context and 8 concurrent requests, which exceeds every single tracked GPU, so it requires tensor parallelism across multiple GPUs. Lower the context, concurrency, or precision to fit fewer cards.
Estimate cost per 1M tokens - Self-host DeepSeek V4 Flash serving cost →
Reference workload for self-hosting DeepSeek V4 Flash
No tracked single GPU holds DeepSeek V4 Flash at this reference shape, so the page shows the VRAM inputs instead of a rental table.
| Input | Value |
|---|---|
| Precision | FP8 |
| Context | 8,192 tokens |
| Concurrency | 8 sequences |
| Required VRAM per GPU | about 388 GB |
| Largest tracked GPU | GB300 (Grace Blackwell Ultra, per GPU) (288 GB) |
Frequently asked questions
What GPU do I need to run DeepSeek V4 Flash?
DeepSeek V4 Flash needs about 388 GB of VRAM per GPU in FP8 at 8K context, which is more than any single tracked GPU, so it requires splitting across multiple GPUs (tensor parallelism).
How is the VRAM figure calculated?
Model weights (parameters times bytes per weight for the precision) plus the KV cache (from the model’s real layers, KV heads, head dimension, and attention pattern) plus activation and a safety margin. Architecture comes from the model’s Hugging Face config; GPU VRAM from the NVIDIA datasheet.
Self-host DeepSeek V4 Flash: GPU and VRAM. ByteCosts. Updated September 6, 2026. https://bytecosts.com/gpu/self-host/deepseek-v4-flash/