# Qwen3 32B GPU requirements: VRAM, GPUs and servers

> Qwen3 32B needs about 66 GB of VRAM in BF16, 33 GB in FP8 and 16 GB in 4-bit, plus KV cache. GPUs and servers that run it, with prices.

Source: https://overgpu.com/models/qwen3-32b  
Updated: 2026-11-03  
Publisher: OverGPU (https://overgpu.com/)

**In short:** Yes. In FP8, a single NVIDIA H100 SXM (80 GB, $2,190 a month at OverGPU) runs Qwen3 32B with an 8k context and 8 concurrent requests; one NVIDIA L40S (48 GB) holds a single 8k request.

## Model facts

- **Developer:** Alibaba Qwen
- **License:** Apache 2.0
- **Type:** Dense
- **Parameters:** 32.8B
- **Layers:** 64
- **Attention:** 64 query heads, 8 KV heads, head dimension 128
- **Context window:** 32k tokens native, about 128k with YaRN

## How much VRAM Qwen3 32B needs

Weights take parameters × bytes per parameter; serving adds the KV cache and about 10% runtime overhead. Totals assume an 8k context with 8 concurrent requests and a BF16 KV cache.

| Precision | Weights | Total to serve | Cheapest OverGPU server that fits |
| --- | --- | --- | --- |
| BF16 | 66 GB | 90 GB | NVIDIA H200 ($3,090/month) |
| FP8 | 33 GB | 54 GB | NVIDIA RTX PRO 6000 Blackwell ($1,390/month) |
| 4-bit | 16 GB | 36 GB | NVIDIA L40S ($890/month) |

## Which GPUs can run Qwen3 32B?

Yes = 8 concurrent requests with an 8k context each; 1 request = a single 8k request at a time; No = does not fit.

| Configuration | BF16 | FP8 | 4-bit |
| --- | --- | --- | --- |
| NVIDIA GeForce RTX 5090 (32 GB, $449/month) | No | No | 1 request |
| NVIDIA L40S (48 GB, $890/month) | No | 1 request | Yes |
| NVIDIA H100 SXM (80 GB, $2,190/month) | No | Yes | Yes |
| NVIDIA RTX PRO 6000 Blackwell (96 GB, $1,390/month) | 1 request | Yes | Yes |
| NVIDIA H200 (141 GB, $3,090/month) | Yes | Yes | Yes |
| NVIDIA B200 (180 GB, $4,590/month) | Yes | Yes | Yes |
| NVIDIA B300 (288 GB, $5,190/month) | Yes | Yes | Yes |
| 8× NVIDIA HGX H100 (8 × 80 GB, $16,900/month) | Yes | Yes | Yes |
| 8× NVIDIA RTX PRO 6000 Blackwell (8 × 96 GB, $10,490/month) | Yes | Yes | Yes |
| 8× NVIDIA HGX H200 (8 × 141 GB, $23,900/month) | Yes | Yes | Yes |
| 8× NVIDIA HGX B200 (8 × 180 GB, $34,900/month) | Yes | Yes | Yes |
| 8× NVIDIA HGX B300 (8 × 288 GB, $39,900/month) | Yes | Yes | Yes |
| 8× AMD Instinct MI355X (8 × 288 GB, $19,900/month) | Yes | Yes | Yes |

## Qwen3 32B KV cache by context length

About 262 MB per 1,000 tokens in flight with a BF16 cache.

| Context per request | 1 request | 8 requests | 32 requests |
| --- | --- | --- | --- |
| 4k tokens | 1.1 GB | 8.6 GB | 34 GB |
| 32k tokens | 8.6 GB | 69 GB | 275 GB |
| 128k tokens | 34 GB | 275 GB | 1,100 GB |

## Memory to fine-tune Qwen3 32B

| Method | Approximate memory | Cheapest OverGPU server that fits |
| --- | --- | --- |
| QLoRA (4-bit base) | 25 GB | NVIDIA GeForce RTX 5090 ($449/month) |
| LoRA (BF16 base) | 81 GB | NVIDIA RTX PRO 6000 Blackwell ($1,390/month) |
| Full fine-tune (AdamW, mixed precision) | 630 GB | 8× NVIDIA RTX PRO 6000 Blackwell ($10,490/month) |

## About Qwen3 32B

Qwen3 32B is the largest dense model of the Qwen3 family: 64 layers, 8 KV heads and Apache 2.0 weights. With 64 layers against 40 for Qwen3 14B, its KV cache per token is 60% larger, so long contexts and high concurrency weigh heavily in your sizing.

Every figure comes from the model's published architecture and the formulas of the VRAM calculator (https://overgpu.com/tools/vram-calculator).

## Frequently asked questions

### How much VRAM does Qwen3 32B need?

About 66 GB for the weights in BF16, 33 GB in FP8 and 16 GB in 4-bit, plus the KV cache: about 262 MB per 1,000 tokens in flight with a BF16 cache. Serving it in FP8 with an 8k context and 8 concurrent requests takes about 54 GB in total.

### Can Qwen3 32B run on a single GPU?

Yes. In FP8, a single NVIDIA RTX PRO 6000 Blackwell (96 GB) serves it with an 8k context and 8 concurrent requests. Longer contexts or more users need more memory for the KV cache, so check your case in the VRAM calculator.

### What is the cheapest OverGPU server for Qwen3 32B?

For FP8 serving with an 8k context and 8 concurrent requests, the NVIDIA RTX PRO 6000 Blackwell at $1,390 per month is the lowest-priced configuration that fits. For other contexts and concurrency, size it in the VRAM calculator.

### How much memory do I need to fine-tune Qwen3 32B?

Roughly 25 GB with QLoRA, 81 GB with LoRA on BF16 weights, and 630 GB for a full fine-tune with AdamW in mixed precision, before tuning batch size and sequence length. Full fine-tunes of large models are sharded across GPUs with FSDP or ZeRO-3.

## Related pages

- [LLM VRAM calculator: will your model fit on a GPU?](https://overgpu.com/tools/vram-calculator): Pick Llama, Qwen, Mistral or gpt-oss, set the precision and context length, and see weights, KV cache and which GPUs fit.
- [How much VRAM do I need for an LLM?](https://overgpu.com/blog/vram-for-llms): Quick answers for 7B, 14B, 32B, 70B and 405B models at BF16, FP8 and 4-bit, plus KV cache by context and the GPU that fits.
- [Best GPU for LLM inference in 2026: a sizing guide by model size](https://overgpu.com/blog/best-gpu-for-llm-inference): Use our 2026 sizing table, from RTX 5090 to 8× B300, to choose.
- [LLM GPU requirements](https://overgpu.com/models): VRAM, KV cache and the cheapest servers for Llama, Qwen3, Mistral and gpt-oss models.