Model Apertus 8B Instruct 2509 Arete 27B d1 2B d1 3B deepseek coder 1.3b instruct deepseek coder 6.7b base deepseek coder 6.7b instruct deepseek coder 7b instruct v1.5 DeepSeek Coder V2 Lite Instruct deepseek moe 16b base DeepSeek OCR DeepSeek OCR 2 DeepSeek R1 DeepSeek R1 0528 DeepSeek R1 0528 Qwen3 8B DeepSeek R1 Distill Llama 70B DeepSeek R1 Distill Llama 8B DeepSeek R1 Distill Qwen 1.5B DeepSeek R1 Distill Qwen 14B DeepSeek R1 Distill Qwen 32B DeepSeek R1 Distill Qwen 7B DeepSeek V2 Chat DeepSeek V2 Lite DeepSeek V2 Lite Chat DeepSeek V3 DeepSeek V3 0324 DeepSeek V3.1 DeepSeek V3.2 DeepSeek V3.2 Exp DeepSeek V4 Flash DeepSeek V4 Flash 0731 DeepSeek V4 Flash DSpark DeepSeek V4 Flash Vision Exp DeepSeek V4 Pro DeepSeek V4 Pro 0813 DeepSeek V4.1 Flash DeepSeek V4.1 Flash 1017 deepseek vl2 tiny diffusiongemma 26B A4B it ERNIE 4.5 21B A3B PT ERNIE 4.5 21B A3B Thinking ERNIE 5.5 Flash Base falcon 40b falcon 7b falcon 7b instruct Falcon H1R 7B FastVLM 0.5B flint gemma 3 12b it gemma 3 27b it gemma 3 4b it gemma 3 4b pt gemma 4 26B A4B it gemma 4 31B gemma 4 31B it GLiDE 27B GLM 4 32B 0414 glm 4 9b GLM 4.1V 9B Thinking GLM 4.5 GLM 4.5 Air GLM 4.5V GLM 4.6 GLM 4.6V GLM 4.6V Flash GLM 4.7 GLM 4.7 Flash GLM 5 GLM 5.1 GLM 5.2 GLM 5.3 GLM 5.3 Flash GLM Z1 32B 0414 GOT OCR 2.0 hf GOT OCR2 0 gpt oss 120b gpt oss 20b gpt oss safeguard 120b gpt oss safeguard 20b granite 3.1 3b a800m instruct granite 3.1 8b instruct granite 3.2 8b instruct granite 3.3 2b instruct granite 3.3 8b instruct granite 4.0 1b granite 4.0 h small granite 4.0 h tiny granite 4.0 micro granite 4.1 3b granite 4.1 3b llmon preview granite 4.1 8b granite 4.1 8b llmon preview granite 4.2 30b granite 4.2 3b granite 4.2 8b granite vision 4.1 4b Hermes 3 Llama 3.1 8B Hermes 3 Llama 3.2 3B Hermes 4.3 36B Hunyuan A13B Instruct HunyuanOCR Hy Memory 30B A3B Hy3 Hy3 preview Hy4 preview Inkling Inkling 2 Small Intern Decision 4B Intern S1 Intern S1 Pro internlm2 5 7b chat internlm2 chat 7b internlm3 8b instruct Kimi Dev 72B Kimi K2 Base Kimi K2 Instruct Kimi K2 Instruct 0905 Kimi K2 Thinking Kimi K2.5 Kimi K2.6 Kimi K2.7 Code Kimi K3 Kimi K3.1 Pro Kimi Linear 48B A3B Instruct Kimi VL A3B Instruct Kimi VL A3B Thinking Kimi VL A3B Thinking 2506 LFM2 1.2B LFM2.5 1.2B Instruct LFM2.5 2.6B LFM2.5 24B A2B LFM2.5 350M LFM2.5 8B A1B LFM2.5 VL 3B LFM2.5 VL 450M LFM3 1.7B LFM3 1.7B Base LFM3 VL 2B LightOnOCR 3 0.8B LightOnOCR 3 4B Ling 1T Ling 2.6 flash Ling 3.0 flash Ling 3.0 flash Sante Ling 3.0 flash VL Ling 3.0 tiny Ling 3.1 flash Ling 3.1 flash 1019 LLaDA2.1 mini Llama 2 7b hf Llama 3.1 70B Llama 3.1 8B Llama 3.1 8B Instruct Llama 3.2 11B Vision Llama 3.2 11B Vision Instruct Llama 3.2 1B Llama 3.2 1B Instruct Llama 3.2 3B Llama 3.2 3B Instruct Llama 3.3 70B Instruct Llama 4 Maverick 17B 128E Instruct Llama 4 Scout 17B 16E Instruct Llama Guard 4 12B LongCat 2.5 LongCat Flash Chat Mage VL Cowork Maxwell V1 Flash medgemma 1.5 4b it medgemma 4b it Meta Llama 3 8B Instruct Meta Llama 3.1 8B Instruct Meta Llama Guard 2 8B MiMo 7B RL MiMo V2 Flash MiMo V2.5 MiMo V2.5 Pro MiMo V2.6 Distill Qwen 9B MiMo V2.6 Flash MOPD MiMo V2.6 Flash RL MiMo V2.6 Pro RL MiniCPM5 2B MiniMax H3 Image PE MiniMax M1 40k MiniMax M2 MiniMax M2.1 MiniMax M2.5 MiniMax M2.7 MiniMax M3 MiniMax M3.1 Flash MiniMax Text 01 Mistral 7B Instruct v0.1 Mistral 7B Instruct v0.2 Mistral 7B v0.1 Molmo2 4B Molmo2 8B Moonlight 16B A3B Instruct Muse Glimmer 30B Muse Spark Open 816B A42B Nemotron 3.5 Parse Nex N2.6 North Mini Code 1.0 Nous Hermes 2 Mixtral 8x7B DPO Nous Hermes 2 Yi 34B OLMo 2 0425 1B Olmo 3 1025 7B Olmo 3 32B Think Olmo 3 7B Instruct Olmo 3 7B Think olmOCR 2 7B 1025 olmOCR 7B 0225 preview OLMoE 1B 7B 0924 Ornith 1.5 122B Ornith 1.5 35B A3B Ornith 1.5 9B PaddleOCR VL 1.6 phi 2 Phi 3 mini 128k instruct Phi 3 mini 4k instruct Phi 3.5 mini instruct Phi 3.5 vision instruct phi 4 Phi 4 mini instruct Qianfan OCR Qwen AgentWorld 35B A3B Qwen2.5 0.5B Instruct Qwen2.5 1.5B Instruct Qwen2.5 3B Instruct Qwen2.5 7B Instruct Qwen2.5 Coder 14B Instruct Qwen2.5 Coder 7B Instruct Qwen2.5 VL 3B Instruct Qwen2.5 VL 7B Instruct Qwen3 0.6B Qwen3 1.7B Qwen3 14B Qwen3 32B Qwen3 4B Qwen3 4B Instruct 2507 Qwen3 8B Qwen3 Coder 30B A3B Instruct Qwen3 VL 4B Instruct Qwen3 VL 8B Instruct Qwen3.5 0.8B Qwen3.5 27B Qwen3.5 2B Qwen3.5 35B A3B Qwen3.5 4B Qwen3.5 9B Qwen3.6 27B Qwen3.6 35B A3B Qwen3.8 2.4T A95B Qwen3.8 27B Qwen3.8 27B DSpine b16 Qwen3.8 Flash Next Raon 1 nano Sage A1.5 Seed OSS 36B Instruct SenseNova Loop 9B Preview SingVL S1 4B SmolLM 1.7B SmolLM2 1.7B SmolLM2 1.7B Instruct SmolLM2 360M SmolLM2 360M Instruct SmolLM3 3B SmolLM3 3B Base SmolVLM 500M Instruct SmolVLM Instruct SmolVLM2 500M Video Instruct Step 3.5 Flash Step 3.7 Flash step3 Step3 VL 10B Trinity Mini UI TARS 1.5 7B UI TARS 7B DPO Unlimited OCR Unlimited OCR 2 WeVisOne VL 2B WeVisOne VL 4B Yi 1.5 34B Chat Yi 34B Yi 34B 200K Yi 34B Chat Yi 6B Yi 6B 200K
GPU or Mac RTX 3060 12GB RTX 3060 Ti RTX 3070 RTX 3080 10GB RTX 3080 12GB RTX 3090 RTX 3090 Ti RTX 4060 RTX 4060 Ti 8GB RTX 4060 Ti 16GB RTX 4070 RTX 4070 Super RTX 4070 Ti RTX 4070 Ti Super RTX 4080 RTX 4080 Super RTX 4090 RTX 5060 RTX 5060 Ti 16GB RTX 5070 RTX 5070 Ti RTX 5080 RTX 5090 2x RTX 3090 2x RTX 4090 2x RTX 5090 RTX A6000 RTX 6000 Ada RTX PRO 6000 Blackwell L40S A100 40GB A100 80GB H100 PCIe H100 SXM H200 DGX Spark RX 7600 RX 7700 XT RX 7800 XT RX 7900 GRE RX 7900 XT RX 7900 XTX RX 9070 RX 9070 XT Ryzen AI Max+ 395 128GB Arc B580 Arc A770 16GB Mac M1 16GB Mac M2 24GB Mac M3 24GB Mac M4 16GB Mac M4 32GB Mac M1 Pro 32GB Mac M3 Pro 36GB Mac M4 Pro 24GB Mac M4 Pro 48GB Mac M4 Pro 64GB Mac M1 Max 64GB Mac M2 Max 96GB Mac M3 Max 128GB Mac M4 Max 64GB Mac M4 Max 128GB Mac M2 Ultra 192GB Mac M3 Ultra 256GB Mac M3 Ultra 512GB
Context 4K 8K 16K 32K 64K 128K 256K
KV cache FP16 Q8_0 (8-bit) Q4_0 (4-bit)