| Kimi Linear 48B A3B Instruct | 49B (3.0B act.) | Q2_K | 17.3 GB | Q2_K | 112 | details |
| Nous Hermes 2 Mixtral 8x7B DPO | 47B (13B act.) | Q2_K | 17.6 GB | Q2_K | 25 | details |
| Falcon 40B | 42B | Q2_K | 16.1 GB | Q2_K | 7.6 | details |
| Flint | 40B (1.3B act.) | Q3_K_M | 19.1 GB | Q2_K | 196 | details |
| Maxwell V1 Flash | 37B (2.3B act.) | Q3_K_M | 17.9 GB | Q3_K_M | 108 | details |
| Hermes 4.3 36B | 36B | Q3_K_M | 19.1 GB | Q2_K | 6.8 | details |
| Seed OSS 36B Instruct | 36B | Q3_K_M | 19.1 GB | Q2_K | 6.8 | details |
| Qwen3.6 35B A3B | 36B (3.0B act.) | Q3_K_M | 17.0 GB | Q3_K_M | 84 | details |
| Ornith 1.5 35B A3B | 36B (3.0B act.) | Q3_K_M | 16.6 GB | Q3_K_M | 86 | details |
| Qwen3.5 35B A3B | 36B (3.0B act.) | Q3_K_M | 17.0 GB | Q3_K_M | 84 | details |
| Sage A1.5 | 36B (4.7B act.) | Q3_K_M | 17.0 GB | Q3_K_M | 53 | details |
| Qwen AgentWorld 35B A3B | 35B (3.0B act.) | Q3_K_M | 16.6 GB | Q3_K_M | 83 | details |
| Yi 34B 200K | 34B | Q3_K_M | 17.9 GB | no | 7.2 | details |
| Yi 34B | 34B | Q3_K_M | 17.9 GB | no | 7.2 | details |
| Yi 34B Chat | 34B | Q3_K_M | 17.9 GB | no | 7.2 | details |
| Yi 1.5 34B Chat | 34B | Q3_K_M | 18.1 GB | Q2_K | 7.1 | details |
| Nous Hermes 2 Yi 34B | 34B | Q3_K_M | 18.4 GB | Q2_K | 7.0 | details |
| DeepSeek R1 Distill Qwen 32B | 33B | Q3_K_M | 17.5 GB | Q2_K | 7.5 | details |
| Qwen3 32B | 33B | Q3_K_M | 17.6 GB | Q2_K | 7.5 | details |
| GLM Z1 32B 0414 | 33B | Q3_K_M | 16.0 GB | Q3_K_M | 7.5 | details |
| GLM 4 32B 0414 | 33B | Q3_K_M | 16.0 GB | Q3_K_M | 7.6 | details |
| Olmo 3 32B Think | 32B | Q3_K_M | 16.4 GB | Q3_K_M | 7.7 | details |
| Granite 4.0 H Small | 32B (8.8B act.) | Q4_K_M | 18.9 GB | Q4_K_M | 23 | details |
| Gemma 4 31B IT | 31B | Q3_K_M | 17.8 GB | Q2_K | 7.5 | details |
| Gemma 4 31B | 31B | Q3_K_M | 17.2 GB | Q2_K | 7.9 | details |
| GLM 4.7 Flash | 31B (4.6B act.) | Q4_K_M | 18.3 GB | Q3_K_M | 44 | details |
| Qwen3 Coder 30B A3B Instruct | 31B (3.0B act.) | Q4_K_M | 18.8 GB | Q3_K_M | 66 | details |
| North Mini Code 1.0 | 30B (3.3B act.) | Q4_K_M | 18.8 GB | Q3_K_M | 59 | details |
| Hy Memory 30B A3B | 30B (3.0B act.) | Q4_K_M | 18.5 GB | Q3_K_M | 65 | details |
| Muse Glimmer 30B | 30B | Q4_K_M | 17.9 GB | Q4_K_M | 6.6 | details |
| Granite 4.2 30B | 29B | Q4_K_M | 19.1 GB | Q2_K | 6.8 | details |
| Raon 1 Mini Preview | 29B (4.3B act.) | Q3_K_M | 14.2 GB | Q3_K_M | 57 | details |
| Qwen3.8 27B | 28B | Q4_K_M | 17.6 GB | Q4_K_M | 6.9 | details |
| Qwen3.6 27B | 28B | Q4_K_M | 18.1 GB | Q3_K_M | 6.7 | details |
| Qwen3.5 27B | 28B | Q4_K_M | 18.1 GB | Q3_K_M | 6.7 | details |
| Gemma 3 27B IT | 27B | Q4_K_M | 17.3 GB | Q4_K_M | 7.3 | details |
| Arete 27B | 27B | Q4_K_M | 17.4 GB | Q4_K_M | 7.0 | details |
| MiniMax H3 Image PE | 27B | Q5_K_M | 19.3 GB | Q4_K_M | 6.2 | details |
| Trinity Mini | 26B (2.0B act.) | Q5_K_M | 18.4 GB | Q5_K_M | 86 | details |
| GLiDE 27B | 26B | Q5_K_M | 18.7 GB | Q4_K_M | 6.5 | details |
| DiffusionGemma 26B A4B IT | 26B (4.0B act.) | Q5_K_M | 19.2 GB | Q4_K_M | 40 | details |
| Gemma 4 26B A4B IT | 26B (4.0B act.) | Q4_K_M | 17.3 GB | Q4_K_M | 45 | details |
| LFM2.5 24B A2B | 24B (2.0B act.) | Q6_K | 19.1 GB | Q5_K_M | 73 | details |
| ERNIE 4.5 21B A3B PT | 22B | Q6_K | 17.9 GB | Q6_K | 6.6 | details |
| ERNIE 4.5 21B A3B Thinking | 22B | Q6_K | 17.9 GB | Q6_K | 6.6 | details |
| gpt-oss Safeguard 20B | 22B (4.8B act.) | F16 | 13.8 GB | F16 | 39 | details |
| gpt-oss 20B | 21B (4.2B act.) | F16 | 13.8 GB | F16 | 43 | details |
| Kimi VL A3B Thinking 2506 | 16B (3.0B act.) | Q8_0 | 16.8 GB | Q8_0 | 39 | details |
| Kimi VL A3B Thinking | 16B (3.0B act.) | Q8_0 | 17.2 GB | Q8_0 | 38 | details |
| Kimi VL A3B Instruct | 16B (3.0B act.) | Q8_0 | 16.8 GB | Q8_0 | 39 | details |
| DeepSeek MoE 16B Base | 16B (2.8B act.) | Q8_0 | 18.6 GB | Q5_K_M | 40 | details |
| LLaDA2.1 Mini | 16B (1.4B act.) | Q8_0 | 17.1 GB | Q8_0 | 79 | details |
| Moonlight 16B A3B Instruct | 16B (3.0B act.) | Q8_0 | 16.8 GB | Q8_0 | 38 | details |
| DeepSeek Coder V2 Lite Instruct | 16B (2.7B act.) | Q8_0 | 16.4 GB | Q8_0 | 42 | details |
| DeepSeek V2 Lite | 16B (2.7B act.) | Q8_0 | 16.4 GB | Q8_0 | 42 | details |
| DeepSeek V2 Lite Chat | 16B (2.7B act.) | Q8_0 | 16.4 GB | Q8_0 | 42 | details |
| Qwen2.5 Coder 14B Instruct | 15B | Q8_0 | 16.8 GB | Q6_K | 7.6 | details |
| DeepSeek R1 Distill Qwen 14B | 15B | Q8_0 | 16.8 GB | Q6_K | 7.6 | details |
| Qwen3 14B | 15B | Q8_0 | 16.6 GB | Q6_K | 7.6 | details |
| Phi 4 | 15B | Q8_0 | 16.7 GB | Q6_K | 7.7 | details |
| Gemma 3 12B IT | 12B | Q8_0 | 13.4 GB | Q8_0 | 9.6 | details |
| Llama Guard 4 12B | 12B | Q8_0 | 14.2 GB | Q8_0 | 9.4 | details |
| KORMo Web 11B | 11B | Q8_0 | 13.0 GB | Q8_0 | 10 | details |
| Llama 3.2 11B Vision Instruct | 11B | Q8_0 | 11.6 GB | Q8_0 | 12 | details |
| Llama 3.2 11B Vision | 11B | Q8_0 | 12.4 GB | Q8_0 | 11 | details |
| GLM 4.6V Flash | 10B | F16 | 18.5 GB | Q8_0 | 6.4 | details |
| GLM 4.1V 9B Thinking | 10B | F16 | 18.5 GB | Q8_0 | 6.4 | details |
| Step3 VL 10B | 10B | F16 | 17.1 GB | Q8_0 | 7.3 | details |
| SenseNova Loop 9B Preview | 9.7B | F16 | 17.8 GB | F16 | 6.7 | details |
| Qwen3.5 9B | 9.7B | F16 | 18.3 GB | F16 | 6.5 | details |
| Ornith 1.5 9B | 9.7B | F16 | 17.8 GB | F16 | 6.7 | details |
| SenseNova Loop 9B | 9.4B | F16 | 18.7 GB | Q8_0 | 6.4 | details |
| MiMo V2.6 Distill Qwen 9B | 9.4B | F16 | 17.8 GB | F16 | 6.7 | details |
| GLM 4 9B | 9.4B | F16 | 18.5 GB | Q8_0 | 6.4 | details |
| Apertus v1.5 8B | 8.9B | F16 | 18.2 GB | Q8_0 | 6.7 | details |
| InternLM3 8B Instruct | 8.8B | F16 | 17.4 GB | F16 | 6.8 | details |
| Granite 4.2 8B | 8.8B | F16 | 18.2 GB | Q8_0 | 6.8 | details |
| Granite 4.1 8B | 8.8B | F16 | 18.2 GB | Q8_0 | 6.8 | details |
| Granite 4.1 8B Llmon Preview | 8.8B | F16 | 18.2 GB | Q8_0 | 6.8 | details |
| Qwen3 VL 8B Instruct | 8.8B | F16 | 17.1 GB | Q8_0 | 7.3 | details |
| Molmo2 8B | 8.7B | F16 | 17.1 GB | Q8_0 | 7.3 | details |
| LFM2.5 8B A1B | 8.5B (1.0B act.) | F16 | 16.5 GB | F16 | 60 | details |
| Qwen2.5 VL 7B Instruct | 8.3B | F16 | 15.3 GB | F16 | 7.9 | details |
| UI TARS 1.5 7B | 8.3B | F16 | 15.3 GB | F16 | 7.9 | details |
| olmOCR 2 7B 1025 | 8.3B | F16 | 15.3 GB | F16 | 7.9 | details |
| olmOCR 7B 0225 Preview | 8.3B | F16 | 16.6 GB | F16 | 7.2 | details |
| UI TARS 7B DPO | 8.3B | F16 | 15.3 GB | F16 | 7.9 | details |
| Qwen3 8B | 8.2B | F16 | 17.1 GB | Q8_0 | 7.3 | details |
| DeepSeek R1 0528 Qwen3 8B | 8.2B | F16 | 17.1 GB | Q8_0 | 7.3 | details |
| Granite 3.3 8B Instruct | 8.2B | F16 | 17.0 GB | Q8_0 | 7.3 | details |
| Granite 3.1 8B Instruct | 8.2B | F16 | 17.0 GB | Q8_0 | 7.3 | details |
| Granite 3.2 8B Instruct | 8.2B | F16 | 17.0 GB | Q8_0 | 7.3 | details |
| Apertus 8B Instruct 2509 | 8.1B | F16 | 16.7 GB | Q8_0 | 7.4 | details |
| Llama 3.1 8B Instruct | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| Llama 3.1 8B | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| Hermes 3 Llama 3.1 8B | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| Llama Guard 3 8B | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| DeepSeek R1 Distill Llama 8B | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| Meta Llama 3 8B Instruct | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| Meta Llama Guard 2 8B | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| Meta Llama 3.1 8B Instruct | 8.0B | F16 | 16.6 GB | Q8_0 | 7.5 | details |
| Aya Expanse 8B | 8.0B | F16 | 16.9 GB | Q8_0 | 7.5 | details |
| Ling 3.0 Tiny | 7.9B (1.4B act.) | F16 | 15.6 GB | F16 | 43 | details |
| MiMo 7B RL | 7.8B | F16 | 16.4 GB | Q8_0 | 7.7 | details |
| InternLM2.5 7B Chat | 7.7B | F16 | 16.0 GB | F16 | 7.8 | details |
| InternLM2 Chat 7B | 7.7B | F16 | 16.0 GB | F16 | 7.8 | details |
| Qwen2.5 7B Instruct | 7.6B | F16 | 15.3 GB | F16 | 7.9 | details |
| DeepSeek R1 Distill Qwen 7B | 7.6B | F16 | 15.3 GB | F16 | 7.9 | details |
| Qwen2.5 Coder 7B Instruct | 7.6B | F16 | 15.3 GB | F16 | 7.9 | details |
| Olmo 3 7B Instruct | 7.3B | F16 | 16.7 GB | Q8_0 | 8.2 | details |
| Olmo 3 1025 7B | 7.3B | F16 | 16.7 GB | Q8_0 | 8.2 | details |
| Olmo 3 7B Think | 7.3B | F16 | 16.7 GB | Q8_0 | 8.2 | details |
| Mistral 7B v0.1 | 7.2B | F16 | 14.9 GB | F16 | 8.3 | details |
| Mistral 7B Instruct v0.2 | 7.2B | F16 | 14.9 GB | F16 | 8.3 | details |
| Mistral 7B Instruct v0.1 | 7.2B | F16 | 14.9 GB | F16 | 8.3 | details |
| Falcon 7B | 7.2B | F16 | 14.0 GB | F16 | 8.3 | details |
| Falcon 7B Instruct | 7.2B | F16 | 14.0 GB | F16 | 8.3 | details |
| Granite 4.0 H Tiny | 6.9B (1.5B act.) | F16 | 13.6 GB | F16 | 41 | details |
| OLMoE 1B 7B 0924 | 6.9B (1.3B act.) | F16 | 14.4 GB | F16 | 47 | details |
| DeepSeek Coder 7B Instruct v1.5 | 6.9B | F16 | 17.2 GB | Q3_K_M | 8.7 | details |
| DeepSeek Coder 6.7B Instruct | 6.7B | F16 | 17.0 GB | Q2_K | 8.9 | details |
| DeepSeek Coder 6.7B Base | 6.7B | F16 | 17.0 GB | Q2_K | 8.9 | details |
| Llama 2 7B HF | 6.7B | F16 | 17.0 GB | Q2_K | 8.9 | details |
| Yi 6B 200K | 6.1B | F16 | 12.3 GB | F16 | 9.9 | details |
| Yi 6B | 6.1B | F16 | 12.3 GB | F16 | 9.9 | details |
| Molmo2 4B | 4.9B | F16 | 10.0 GB | F16 | 14 | details |
| WeVisOne VL 4B | 4.8B | F16 | 10.0 GB | F16 | 14 | details |
| Mage VL Cowork | 4.7B | F16 | 10.0 GB | F16 | 14 | details |
| Qianfan OCR | 4.7B | F16 | 10.1 GB | F16 | 14 | details |
| Qwen3.5 4B | 4.7B | F16 | 9.2 GB | F16 | 14 | details |
| SingVL S1 4B | 4.5B | F16 | 9.0 GB | F16 | 14 | details |
| LightOnOCR 3 4B | 4.5B | F16 | 9.0 GB | F16 | 14 | details |
| Intern Decision 4B | 4.5B | F16 | 9.0 GB | F16 | 14 | details |
| Qwen3 VL 4B Instruct | 4.4B | F16 | 9.3 GB | F16 | 15 | details |
| Gemma 3 4B IT | 4.3B | F16 | 8.4 GB | F16 | 15 | details |
| MedGemma 1.5 4B IT | 4.3B | F16 | 8.4 GB | F16 | 15 | details |
| MedGemma 4B IT | 4.3B | F16 | 8.4 GB | F16 | 15 | details |
| TranslateGemma 4B IT | 4.3B | F16 | 9.2 GB | F16 | 14 | details |
| Gemma 3 4B PT | 4.3B | F16 | 8.4 GB | F16 | 15 | details |
| Phi 3.5 Vision Instruct | 4.1B | F16 | 11.2 GB | Q8_0 | 14 | details |
| Qwen3 4B | 4.0B | F16 | 9.3 GB | F16 | 15 | details |
| Qwen3 4B Instruct 2507 | 4.0B | F16 | 9.3 GB | F16 | 15 | details |
| Granite Vision 4.1 4B | 4.0B | F16 | 7.6 GB | F16 | 18 | details |
| Phi 4 Mini Instruct | 3.8B | F16 | 8.9 GB | F16 | 16 | details |
| Phi 3 Mini 4K Instruct | 3.8B | F16 | 10.6 GB | Q8_0 | 16 | details |
| Phi 3.5 Mini Instruct | 3.8B | F16 | 10.6 GB | Q8_0 | 16 | details |
| Phi 3 Mini 128K Instruct | 3.8B | F16 | 10.6 GB | Q8_0 | 16 | details |
| Qwen2.5 VL 3B Instruct | 3.8B | F16 | 8.0 GB | F16 | 16 | details |
| Granite 4.2 3B | 3.7B | F16 | 8.0 GB | F16 | 16 | details |
| Granite 4.1 3B Llmon Preview | 3.7B | F16 | 8.0 GB | F16 | 16 | details |
| Raon 1 Nano | 3.5B | F16 | 7.0 GB | F16 | 19 | details |
| Granite 4.1 3B | 3.4B | F16 | 7.6 GB | F16 | 18 | details |
| Granite 4.0 Micro | 3.4B | F16 | 7.6 GB | F16 | 18 | details |
| DeepSeek OCR 2 | 3.4B (1.2B act.) | F16 | 6.6 GB | F16 | 58 | details |
| DeepSeek VL2 Tiny | 3.4B (1.2B act.) | F16 | 7.4 GB | F16 | 51 | details |
| Tiny Aya Global | 3.3B | F16 | 7.5 GB | F16 | 18 | details |
| Unlimited OCR 2 | 3.3B (1.1B act.) | F16 | 6.6 GB | F16 | 59 | details |
| Unlimited OCR | 3.3B (1.1B act.) | F16 | 6.6 GB | F16 | 60 | details |
| DeepSeek OCR | 3.3B (1.1B act.) | F16 | 6.6 GB | F16 | 60 | details |
| Granite 3.1 3B A800M Instruct | 3.3B (883M act.) | F16 | 7.1 GB | F16 | 68 | details |
| Llama 3.2 3B Instruct | 3.2B | F16 | 7.5 GB | F16 | 19 | details |
| Llama 3.2 3B | 3.2B | F16 | 7.5 GB | F16 | 19 | details |
| Hermes 3 Llama 3.2 3B | 3.2B | F16 | 7.5 GB | F16 | 19 | details |
| d1 3B | 3.1B | F16 | 5.8 GB | F16 | 22 | details |
| LFM2.5 VL 3B | 3.1B | F16 | 5.8 GB | F16 | 22 | details |
| Qwen2.5 3B Instruct | 3.1B | F16 | 6.7 GB | F16 | 19 | details |
| SmolLM3 3B | 3.1B | F16 | 6.9 GB | F16 | 19 | details |
| SmolLM3 3B Base | 3.1B | F16 | 6.9 GB | F16 | 20 | details |
| Phi 2 | 2.8B | F16 | 8.2 GB | F16 | 22 | details |
| LFM2.5 2.6B | 2.7B | F16 | 10.8 GB | F16 | 11 | details |
| Granite 3.3 2B Instruct | 2.5B | F16 | 5.8 GB | F16 | 24 | details |
| MiniCPM5 2B | 2.5B | F16 | 5.7 GB | F16 | 24 | details |
| WeVisOne VL 2B | 2.4B | F16 | 5.4 GB | F16 | 29 | details |
| Cosmos Reason2 2B | 2.4B | F16 | 5.4 GB | F16 | 29 | details |
| Qwen3.5 2B | 2.3B | F16 | 4.6 GB | F16 | 31 | details |
| SmolVLM Instruct | 2.2B | F16 | 5.4 GB | F16 | 33 | details |
| Qwen3 1.7B | 2.0B | F16 | 5.4 GB | F16 | 29 | details |
| d1 2B | 1.9B | F16 | 4.0 GB | F16 | 35 | details |
| LFM3 VL 2B | 1.9B | F16 | 4.0 GB | F16 | 35 | details |
| DeepSeek R1 Distill Qwen 1.5B | 1.8B | F16 | 4.2 GB | F16 | 34 | details |
| LFM3 1.7B | 1.7B | F16 | 7.2 GB | F16 | 17 | details |
| LFM3 1.7B Base | 1.7B | F16 | 4.0 GB | F16 | 35 | details |
| SmolLM2 1.7B Instruct | 1.7B | F16 | 5.2 GB | F16 | 35 | details |
| SmolLM2 1.7B | 1.7B | F16 | 5.2 GB | F16 | 35 | details |
| SmolLM 1.7B | 1.7B | F16 | 5.2 GB | F16 | 35 | details |
| Granite 4.0 1B | 1.6B | F16 | 4.3 GB | F16 | 37 | details |
| Qwen2.5 1.5B Instruct | 1.5B | F16 | 3.8 GB | F16 | 39 | details |
| OLMo 2 0425 1B | 1.5B | F16 | 4.4 GB | F16 | 40 | details |
| DeepSeek Coder 1.3B Instruct | 1.3B | F16 | 4.5 GB | F16 | 45 | details |
| Llama 3.2 1B | 1.2B | F16 | 3.2 GB | F16 | 48 | details |
| Llama 3.2 1B Instruct | 1.2B | F16 | 3.2 GB | F16 | 48 | details |
| LFM2.5 1.2B Instruct | 1.2B | F16 | 5.0 GB | F16 | 26 | details |
| LFM2 1.2B | 1.2B | F16 | 3.0 GB | F16 | 51 | details |
| HunyuanOCR | 1.1B | F16 | 3.5 GB | F16 | 54 | details |
| PaddleOCR VL 1.6 | 959M | F16 | 2.5 GB | F16 | 63 | details |
| Qwen3.5 0.8B | 873M | F16 | 2.4 GB | F16 | 77 | details |
| LightOnOCR 3 0.8B | 853M | F16 | 2.4 GB | F16 | 79 | details |
| FastVLM 0.5B | 759M | F16 | 2.2 GB | F16 | 79 | details |
| Qwen3 0.6B | 752M | F16 | 3.0 GB | F16 | 80 | details |
| GOT OCR2.0 | 716M | F16 | 2.8 GB | F16 | 84 | details |
| Nemotron 3.5 Parse | 631M | F16 | 1.9 GB | F16 | 92 | details |
| GOT OCR 2.0 HF | 561M | F16 | 2.5 GB | F16 | 107 | details |
| SmolVLM2 500M Video Instruct | 507M | F16 | 1.6 GB | F16 | 146 | details |
| SmolVLM 500M Instruct | 507M | F16 | 1.6 GB | F16 | 146 | details |
| Qwen2.5 0.5B Instruct | 494M | F16 | 1.7 GB | F16 | 121 | details |
| LFM2.5 VL 450M | 449M | F16 | 1.3 GB | F16 | 169 | details |
| SmolLM2 360M Instruct | 362M | F16 | 1.5 GB | F16 | 165 | details |
| SmolLM2 360M | 362M | F16 | 1.5 GB | F16 | 165 | details |
| LFM2.5 350M | 354M | F16 | 1.9 GB | F16 | 84 | details |