What AI models run on the RTX 5090?
The RTX 5090 has 32 GB of VRAM (1,792 GB/s). About 30.4 GB is usable for a model. 218 of 298 open models we track fit at 8K context.
This card has 32 GB of VRAM. See every model that fits in 32 GB VRAM. Other 32 GB hardware: Mac M4 32GB, Mac M1 Pro 32GB.
Compare for local LLMs: RTX 5090 vs RTX 5080RTX 5090 vs RTX 4090RTX 5090 vs RTX 3090RTX 5090 vs Mac M4 Max 128GBRTX 5090 vs DGX Spark all comparisons
Using a specific tool? Ollama models that run on the RTX 5090 · LM Studio · llama.cpp offload
Models that fit, largest first
Bigger models with CPU offload
These popular models don't fit in the RTX 5090's VRAM at 4-bit, but run with llama.cpp offload, keeping part of the model in system RAM. Speed range is DDR4-3200 to DDR5-6000 (estimate). Method.
| Model | Params | Offload plan |
|---|---|---|
| GLM 5.3 Flash | 321B MoE | Offload Q3_K_M, 128 GB RAM · ~6.3–13 tok/s |
| gpt-oss 120B | 117B MoE | Offload Q4_K_M, 64 GB RAM · ~22–44 tok/s |
| DeepSeek V4 Flash 0731 | 304B MoE | Offload Q3_K_M, 128 GB RAM · ~7.7–15 tok/s |
| DeepSeek V4 Flash | 291B MoE | Offload Q3_K_M, 128 GB RAM · ~8.4–17 tok/s |
| MiniMax M2.5 | 229B MoE | Offload Q4_K_M, 128 GB RAM · ~6.6–14 tok/s |
| Hy3 | 299B MoE | Offload Q3_K_M, 128 GB RAM · ~4.9–10 tok/s |
Comparing cards? The RTX 5090 (launch MSRP $1999) is in best GPUs for local LLMs under $2,000. See also Mac vs PC.
Questions
What is the biggest model that runs on the RTX 5090?
Of the models we track, the largest that fits at 8K context is Hunyuan A13B Instruct (80B) at Q2_K, needing about 28.6 GB.
How much of the RTX 5090's memory can a model use?
About 30.4 GB: we assume 95% of the 32 GB is usable after driver and display overhead.
Spec source: NVIDIA specifications. Model data: Hugging Face Hub API. Speed is a bandwidth ceiling (bandwidth ÷ bytes read per token), not a benchmark. Methodology · Report an error.