What AI models run on the RTX 4060 Ti 8GB?
The RTX 4060 Ti 8GB has 8 GB of VRAM (288 GB/s). About 7.6 GB is usable for a model. 153 of 285 open models we track fit at 8K context.
This card has 8 GB of VRAM. See every model that fits in 8 GB VRAM. Other 8 GB hardware: RTX 3060 Ti, RTX 3070, RTX 4060, RTX 5060, RX 7600.
Models that fit, largest first
Just too big at 4-bit
These need up to 35% more memory than the RTX 4060 Ti 8GB has at Q4_K_M and 8K context. A smaller quant or shorter context may work.
| Model | Q4_K_M needs | Short by |
|---|---|---|
| Llama 3.2 11B Vision | 8.0 GB | 0.4 GB |
| Llama 2 7b hf | 8.3 GB | 0.7 GB |
| deepseek coder 6.7b base | 8.3 GB | 0.7 GB |
| deepseek coder 6.7b instruct | 8.3 GB | 0.7 GB |
| deepseek coder 7b instruct v1.5 | 8.3 GB | 0.7 GB |
| gemma 3 12b it | 8.5 GB | 0.9 GB |
| Llama Guard 4 12B | 9.1 GB | 1.5 GB |
| falcon 7b instruct | 9.4 GB | 1.8 GB |
| falcon 7b | 9.6 GB | 2.0 GB |
| DeepSeek V2 Lite | 9.8 GB | 2.2 GB |
Questions
What is the biggest model that runs on the RTX 4060 Ti 8GB?
Of the models we track, the largest that fits at 8K context is Kimi VL A3B Thinking 2506 (16B) at Q2_K, needing about 6.7 GB.
How much of the RTX 4060 Ti 8GB's memory can a model use?
About 7.6 GB: we assume 95% of the 8 GB is usable after driver and display overhead.
Spec source: NVIDIA specifications. Model data: Hugging Face Hub API. Speed is a bandwidth ceiling (bandwidth ÷ bytes read per token), not a benchmark. Methodology · Report an error.