AI Model Families for Local Inference
Browse open-weight model families you can run locally with Ollama. Each family page shows all variants, RAM requirements, device compatibility, and performance expectations.
- models tracked
- 201
- local rows
- 157
- quant classes
- 10
- registry-verified
- 126
Quality-gated, not inflated
ModelFit tracks 201 models across 41 families, with 157 local rows. Every Ollama command is registry-verified before it ships, and low-quality 2-bit quants stay out of the ranking even when they technically exist.
- Default policy
- Q4_K_M is the default recommendation tier; Q6/Q8 variants appear when they add real quality headroom.
- Freshness
- Catalog snapshot updated 2026-11-16; new tags enter through the registry-check pipeline, not from scraped guesses.
- Honest coverage
- A smaller verified catalog beats a bigger list padded with broken tags and unusable quants.
AI model families for local use
8 families| Family | Maker | Models | Sizes | Notes |
|---|---|---|---|---|
| Alibaba Cloud | 40 | 0.5B-235B | Qwen is Alibaba Cloud's open-weight model family spanning 0.5B to 2.4T parameters. Qwen3.8 27B is the local flagship: a dense, Apache 2.0 vision-language model, while the Qwen3.8 2.4T A95B MoE tops the cloud line.Qwen3.8 27B local flagship (Apache 2.0, vision) · Cloud line tops out at the 2.4T A95B MoE | |
| Meta | 12 | 1B-405B | Llama is Meta's open-weight model family and the most popular choice for local AI. The Llama 4 line brings multimodal MoE models for big-memory machines, while the 1B-70B Llama 3.x sizes remain the practical laptop and desktop picks.Most popular open-weight model family · Strong general reasoning and instruction following | |
| DeepSeek AI | 8 | 7B-671B | DeepSeek now ships two distinct lines. The V4 generation is cloud-first: V4.1 Flash is an MIT-licensed multimodal image + text MoE, and V4 Flash 0731 and V4 Pro are API models. On consumer hardware DeepSeek means the R1 reasoning distills, from 7B up to the full 671B, all registry-verified in Ollama.V4.1 Flash: multimodal 552B MoE, API only · R1 distills 7B-70B run locally in Ollama | |
| Mistral AI | 14 | 3.4B-123B | Mistral AI's models are known for efficiency and strong performance relative to their size. Mistral 7B was a breakthrough that proved small models could compete with much larger ones.Excellent performance-per-parameter ratio · Sliding window attention for efficiency | |
| Google DeepMind | 19 | 1B-31B | Gemma is Google DeepMind's efficient open model family, tuned for strong quality at small sizes. The Gemma 4 line spans an on-device 4.5B model up to a dense 31B and a 26B MoE, all Apache 2.0.Gemma 4 E4B: 4.5B effective, runs on 8GB Macs · Gemma 4 26B-A4B MoE: 25.2B total, 3.8B active | |
| Microsoft | 6 | 3.8B-14B | Phi is Microsoft's small-but-mighty model family, built on the idea that careful training data beats raw parameter count. Phi-4 Mini packs strong reasoning into just 3.8B parameters, while Phi-4 14B competes with much larger models on quality. Both run locally with Ollama and pair naturally with low-RAM Apple Silicon Macs.Best quality-per-gigabyte at small sizes · Phi-4 Mini 3.8B loads in just 3.2GB (7GB min RAM) | |
| Liquid AI | 2 | 8.3B-24B | LFM2 is Liquid AI's efficiency-focused model family, built on a hybrid architecture rather than a standard dense transformer. Its flagship, LFM2 24B-A2B, is a sparse mixture-of-experts model that activates only 2B of its 24B parameters per token. That design makes it fast on consumer hardware and well suited to agent workflows, tool calling, and privacy-sensitive local setups.Hybrid MoE design: 24B total parameters, only 2B active per token · Loads in about 14GB, fits any 16GB Mac | |
| Hugging Face | 1 | 0.36B-0.36B | SmolLM is Hugging Face's ultra-tiny model family for the most constrained devices. SmolLM2 360M loads in about 0.5GB and runs on anything with 1GB of RAM, from old Macs and iPhones to embedded boards. It is the smallest model in our database and the fastest by speed score.Tiny 360M-parameter model from Hugging Face · Loads in about 0.5GB, needs just 1GB of RAM |
API-only & open-weights flagships
Frontier models you don't run on a laptop: hosted APIs, often with open weights. Each page says what it does and lists the local alternatives that actually fit your machine.
Browse every model
156 model pagesDeepSeek11
Gemma12
Llama8
Mistral13
Other models77
- Kimi K2 Instruct
- Claude 3.5 Sonnet
- Claude 3.7 Sonnet
- Claude 3 Opus
- Claude 4 Opus
- Microsoft Mage-VL-Cowork
- GPT-4o
- GPT-4o mini
- Claude 4 Sonnet
- Gemini 2.5 Pro
- Gemini 2.5 Flash
- GLM-5
- GLM-4 Plus
- Granite 4.1 3B Instruct
- Granite 4.1 8B Instruct
- Kimi K2.6
- GLM-5.1
- Claude Opus 4.7
- Claude Opus 4.8
- GPT-5.5
- Gemini 3.1 Pro
- Grok 4.3
- Claude Fable 5
- GLM-5.2
- Kimi K2.7-Code
- MiniMax M3
- NVIDIA Nemotron 3 Ultra
- Xiaomi MiMo-V2-Flash
- NVIDIA Nemotron Cascade 2 30B-A3B
- Poolside Laguna XS.2
- Cohere North Mini Code
- GPT-OSS 120B
- GPT-OSS 20B
- Kimi K3
- Laguna XS 2.1
- Laguna S 2.1
- Ornith 1.0 9B
- Ornith 1.0 35B
- Granite 4.2 3B
- Granite 4.2 8B
- Granite 4.2 30B
- Nemotron 3.5 Lightning 30B-A3B
- Muse Glimmer 30B
- MiniCPM-V 4.5 8B
- GLM-5.3
- GLM-5.3 Flash
- GLM-4.7-Flash 30B-A3B
- GLM-4-9B-Chat
- Nemotron 3 Super 120B-A12B
- Olmo 3.1 32B Instruct
- MiMo-V2.6-Distill-Qwen-9B
- Ling-3.0-flash
- Xiaomi MiMo-V2.6-Flash
- Xiaomi MiMo-V2.6-Pro
- Inkling Small
- Flint 40B-A2.5B
- Mellum2.1 12B-A2.5B Thinking
- Kolibri 1
- AREX-2 27B
- Arete 27B
- TwIL-8B
- Nanbeige4.3 33B
- Ripple 65B Preview
- Muse Spark Open
- MiniMax M3.1 Flash
- Beam 1.0
- NVIDIA Nemotron 3.5 Bolt E4B
- NVIDIA Nemotron 3.5 Bolt 74B-A9B
- Granite Switch 4.1 8B
- Granite Switch 4.1 30B
- Jebadiah 9B
- Jebadiah 27B
- LFM3 1.7B
- Ling-3.1-flash-1019
- Tencent Hy4 Preview
- Ornith 1.5 122B
- Sage-A1.5
Qwen28
- Qwen2.5 1.5B Instruct
- Qwen2.5 3B Instruct
- Qwen2.5 7B Instruct
- Qwen2.5 14B Instruct
- Qwen2.5 Coder 7B
- Qwen2.5 Coder 14B
- Qwen2.5 0.5B Instruct
- Qwen3 8B
- Qwen3 14B
- Qwen3 30B
- Qwen3 30B (Q8)
- Qwen3 32B
- Qwen3 Coder 30B-A3B
- Qwen3 235B A22B
- Qwen3.5 0.8B Instruct
- Qwen3.5 2B Instruct
- Qwen3.5 4B Instruct
- Qwen3.5 9B Instruct
- Qwen3.5 35B-A3B Instruct
- Qwen3.5 27B Instruct
- Qwen3.5 122B-A10B Instruct
- Qwen3.6 27B
- Qwen3.8 27B
- Qwen3.6 35B-A3B
- Qwen3.7-Plus
- Qwen3-Next 80B-A3B
- Qwen3.8-Flash-Next
- Qwen3.8 2.4T A95B
SmolLM1
Full model catalog
Filter every tracked model by RAM, family, runtime and context budget. Load figures and fit rules come from the same dataset that powers the wizard.
| Family | Quant | Local | ollama | ||||
|---|---|---|---|---|---|---|---|
| Qwen2.5 1.5B Instruct | Qwen | 1.5B | Q4_K_M | 4 GB | ~1.5 GB | Yes | qwen2.5:1.5b-instruct-q4_K_M |
| Qwen2.5 3B Instruct | Qwen | 3B | Q4_K_M | 4 GB | ~2.5 GB | Yes | qwen2.5:3b-instruct-q4_K_M |
| Qwen2.5 7B Instruct | Qwen | 7B | Q4_K_M | 8 GB | ~5.5 GB | Yes | qwen2.5:7b-instruct-q4_K_M |
| Qwen2.5 14B Instruct | Qwen | 14B | Q4_K_M | 16 GB | ~11 GB | Yes | qwen2.5:14b-instruct-q4_K_M |
| Llama 3.2 3B Instruct | Llama | 3B | Q4_K_M | 4 GB | ~2.5 GB | Yes | llama3.2:3b-instruct-q4_K_M |
| Llama 3.1 8B Instruct | Llama | 8B | Q4_K_M | 12 GB | ~6.5 GB | Yes | llama3.1:8b-instruct-q4_K_M |
| Llama 3.1 8B Instruct (Q8) | Llama | 8B | Q8_0 | 16 GB | ~8 GB | Yes | llama3.1:8b-instruct-q8_0 |
| Llama 3.1 8B Instruct (Q5) | Llama | 8B | Q5_K_M | 12 GB | ~8 GB | Yes | llama3.1:8b-instruct-q5_K_M |
| Llama 3.1 70B Instruct | Llama | 70B | Q4_K_M | 64 GB | ~42 GB | Yes | llama3.1:70b-instruct-q4_K_M |
| Mistral 7B Instruct | Mistral | 7B | Q4_K_M | 8 GB | ~5.5 GB | Yes | mistral:7b-instruct-v0.3-q4_K_M |
| Mistral 7B Instruct (Q5) | Mistral | 7B | Q5_K_M | 8 GB | ~4.8 GB | Yes | mistral:7b-instruct-v0.3-q5_K_M |
| Mistral 7B Instruct (Q8) | Mistral | 7B | Q8_0 | 16 GB | ~7.2 GB | Yes | mistral:7b-instruct-v0.3-q8_0 |
| Mixtral 8x7B Instruct | Mistral | 46.7B | Q4_K_M | 48 GB | ~30 GB | Yes | mixtral:8x7b |
| Mistral Nemo 12B | Mistral | 12B | Q4_K_M | 16 GB | ~9.5 GB | Yes | mistral-nemo:12b |
| Mistral Nemo 12B (Q8) | Mistral | 12B | Q8_0 | 24 GB | ~12.1 GB | Yes | mistral-nemo:12b-instruct-2407-q8_0 |
| Gemma 2 2B Instruct | Gemma | 2B | Q4_K_M | 4 GB | ~1.8 GB | Yes | gemma2:2b-instruct-q4_K_M |
| Gemma 2 9B Instruct | Gemma | 9B | Q4_K_M | 12 GB | ~7 GB | Yes | gemma2:9b-instruct-q4_K_M |
| Gemma 2 27B Instruct | Gemma | 27B | Q4_K_M | 32 GB | ~21 GB | Yes | gemma2:27b-instruct-q4_K_M |
| Phi-3 Mini 3.8B | Phi | 3.8B | Q4_K_M | 6 GB | ~3.2 GB | Yes | phi3:3.8b-mini-4k-instruct-q4_K_M |
| Phi-3 Medium 14B | Phi | 14B | Q4_K_M | 16 GB | ~11 GB | Yes | phi3:14b-medium-4k-instruct-q4_K_M |
| Phi-4 14B | Phi | 14B | Q4_K_M | 24 GB | ~11.5 GB | Yes | phi4:14b-q4_K_M |
| Phi-4 14B (Q8) | Phi | 14B | Q8_0 | 24 GB | ~14.5 GB | Yes | phi4:14b-q8_0 |
| Qwen2.5 Coder 7B | Qwen | 7B | Q4_K_M | 8 GB | ~5.5 GB | Yes | qwen2.5-coder:7b |
| Qwen2.5 Coder 14B | Qwen | 14B | Q4_K_M | 16 GB | ~11 GB | Yes | qwen2.5-coder:14b |
| Llama 3.2 1B Instruct | Llama | 1B | Q4_K_M | 2 GB | ~1 GB | Yes | llama3.2:1b-instruct-q4_K_M |
| Mistral Small 22B | Mistral | 22B | Q4_K_M | 32 GB | ~17 GB | Yes | mistral-small:22b |
| Kimi K2 Instruct | Kimi | 1000B | API | 0 GB | n/a | Open, no fit | n/a |
| Claude 3.5 Sonnet | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Claude 3.7 Sonnet | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Claude 3 Opus | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Claude 4 Opus | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Qwen2.5 0.5B Instruct | Qwen | 0.5B | Q4_K_M | 2 GB | ~0.8 GB | Yes | qwen2.5:0.5b-instruct-q4_K_M |
| Gemma 3 1B Instruct | Gemma | 1B | Q4_K_M | 2 GB | ~1 GB | Yes | gemma3:1b |
| Gemma 3 1B Instruct (Q8) | Gemma | 1B | Q8_0 | 4 GB | ~1 GB | Yes | gemma3:1b-it-q8_0 |
| Phi-4 Mini 3.8B | Phi | 3.8B | Q4_K_M | 6 GB | ~3.2 GB | Yes | phi4-mini:3.8b |
| Phi-4 Mini 3.8B (Q8) | Phi | 3.8B | Q8_0 | 8 GB | ~3.8 GB | Yes | phi4-mini:3.8b-q8_0 |
| Microsoft Mage-VL-Cowork | Mage | 4B | Q4_K_M | 8 GB | ~2.7 GB | Yes | n/a |
| SmolLM2 360M | SmolLM | 0.36B | Q4_K_M | 1 GB | ~0.5 GB | Yes | smollm2:360m |
| Llama 3.3 70B Instruct | Llama | 70B | Q4_K_M | 64 GB | ~42 GB | Yes | llama3.3:70b-instruct-q4_K_M |
| Llama 3.1 405B Instruct | Llama | 405B | Q4_K_M | 320 GB | ~243 GB | Yes | llama3.1:405b-instruct-q4_K_M |
| DeepSeek-R1 671B | DeepSeek | 671B | Q4_K_M | 512 GB | ~380 GB | Yes | deepseek-r1:671b-q4_K_M |
| Qwen3 8B | Qwen | 8B | Q4_K_M | 12 GB | ~6.5 GB | Yes | qwen3:8b-q4_K_M |
| Qwen3 8B (Q8) | Qwen | 8B | Q8_0 | 16 GB | ~8.1 GB | Yes | qwen3:8b-q8_0 |
| Qwen3 14B | Qwen | 14B | Q4_K_M | 16 GB | ~11 GB | Yes | qwen3:14b-q4_K_M |
| Qwen3 30B | Qwen | 30B | Q4_K_M | 32 GB | ~22 GB | Yes | qwen3:30b-a3b-q4_K_M |
| Qwen3 30B (Q8) | Qwen | 30B | Q8_0 | 48 GB | ~30.3 GB | Yes | qwen3:30b-a3b-q8_0 |
| Qwen3 32B | Qwen | 32B | Q4_K_M | 32 GB | ~20.2 GB | Yes | qwen3:32b-q4_K_M |
| Qwen3 32B (Q8) | Qwen | 32B | Q8_0 | 64 GB | ~35.1 GB | Yes | qwen3:32b-q8_0 |
| Qwen3 Coder 30B-A3B | Qwen | 30.5B | Q4_K_M | 32 GB | ~18.6 GB | Yes | qwen3-coder:30b-a3b-q4_K_M |
| Qwen3 Coder 30B-A3B (Q8) | Qwen | 30.5B | Q8_0 | 48 GB | ~32.5 GB | Yes | qwen3-coder:30b-a3b-q8_0 |
| Gemma 3 4B Instruct | Gemma | 4B | Q4_K_M | 6 GB | ~3.5 GB | Yes | gemma3:4b |
| Gemma 3 4B Instruct (Q8) | Gemma | 4B | Q8_0 | 8 GB | ~3.9 GB | Yes | gemma3:4b-it-q8_0 |
| Gemma 3 12B Instruct | Gemma | 12B | Q4_K_M | 16 GB | ~9.5 GB | Yes | gemma3:12b |
| Gemma 3 27B Instruct | Gemma | 27B | Q4_K_M | 32 GB | ~21 GB | Yes | gemma3:27b |
| DeepSeek-R1 Distill Qwen 7B | DeepSeek | 7B | Q4_K_M | 8 GB | ~5.5 GB | Yes | deepseek-r1:7b |
| DeepSeek-R1 Distill Qwen 7B (Q8) | DeepSeek | 7B | Q8_0 | 16 GB | ~7.5 GB | Yes | deepseek-r1:7b-qwen-distill-q8_0 |
| DeepSeek-R1 Distill Qwen 14B | DeepSeek | 14B | Q4_K_M | 16 GB | ~11 GB | Yes | deepseek-r1:14b |
| DeepSeek-R1 Distill Qwen 14B (Q8) | DeepSeek | 14B | Q8_0 | 24 GB | ~14.6 GB | Yes | deepseek-r1:14b-qwen-distill-q8_0 |
| DeepSeek-R1 Distill Qwen 32B | DeepSeek | 32B | Q4_K_M | 32 GB | ~19.9 GB | Yes | deepseek-r1:32b-qwen-distill-q4_K_M |
| DeepSeek-R1 Distill Qwen 32B (Q8) | DeepSeek | 32B | Q8_0 | 64 GB | ~34.8 GB | Yes | deepseek-r1:32b-qwen-distill-q8_0 |
| DeepSeek-R1 Distill Llama 70B | DeepSeek | 70B | Q4_K_M | 64 GB | ~42 GB | Yes | deepseek-r1:70b |
| GPT-4o | OpenAI | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| GPT-4o mini | OpenAI | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Claude 4 Sonnet | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Gemini 2.5 Pro | Undisclosed | API | 0 GB | n/a | Cloud | n/a | |
| Gemini 2.5 Flash | Undisclosed | API | 0 GB | n/a | Cloud | n/a | |
| DeepSeek-V3 | DeepSeek | 671B | API | 0 GB | n/a | Open, no fit | n/a |
| GLM-5 | Zhipu | 744B | API | 0 GB | n/a | Open, no fit | n/a |
| GLM-4 Plus | Zhipu | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Qwen3 235B A22B | Qwen | 235B | Q4_K_M | 192 GB | ~130 GB | Yes | qwen3:235b-a22b-q4_K_M |
| Mistral Small 3.1 | Mistral | 24B | Q4_K_M | 24 GB | ~15 GB | Yes | mistral-small3.1:24b |
| Mistral Small 3.1 (Q8) | Mistral | 24B | Q8_0 | 36 GB | ~23.3 GB | Yes | mistral-small3.1:24b-instruct-2503-q8_0 |
| DeepSeek-V3-0324 | DeepSeek | 671B | API | 0 GB | n/a | Open, no fit | n/a |
| DeepSeek-R1 | DeepSeek | 671B | API | 0 GB | n/a | Open, no fit | n/a |
| Qwen3.5 0.8B Instruct | Qwen | 0.8B | Q4_K_M | 2 GB | ~0.8 GB | Yes | qwen3.5:0.8b |
| Qwen3.5 2B Instruct | Qwen | 2B | Q4_K_M | 4 GB | ~1.8 GB | Yes | qwen3.5:2b |
| Qwen3.5 4B Instruct | Qwen | 4B | Q4_K_M | 6 GB | ~3.5 GB | Yes | qwen3.5:4b |
| Qwen3.5 4B Instruct (Q8) | Qwen | 4B | Q8_0 | 8 GB | ~4.3 GB | Yes | qwen3.5:4b-q8_0 |
| Qwen3.5 9B Instruct | Qwen | 9B | Q4_K_M | 12 GB | ~7 GB | Yes | qwen3.5:9b |
| Qwen3.5 35B-A3B Instruct | Qwen | 35B | Q4_K_M | 32 GB | ~20 GB | Yes | qwen3.5:35b-a3b |
| Qwen3.5 27B Instruct | Qwen | 27B | Q4_K_M | 24 GB | ~16 GB | Yes | qwen3.5:27b |
| Qwen3.5 27B Instruct (Q8) | Qwen | 27B | Q8_0 | 48 GB | ~27.1 GB | Yes | qwen3.5:27b-q8_0 |
| Qwen3.5 122B-A10B Instruct | Qwen | 122B | Q4_K_M | 96 GB | ~72 GB | Yes | qwen3.5:122b-a10b |
| LFM2 24B-A2B Instruct | LFM2 | 24B | Q4_K_M | 24 GB | ~14 GB | Yes | lfm2:24b-a2b |
| LFM2.5 8B-A1B | LFM2 | 8.3B | Q4_K_M | 8 GB | ~5.5 GB | Yes | lfm2.5:8b-a1b-q4_K_M |
| Granite 4.1 3B Instruct | Granite | 3B | Q4_K_M | 4 GB | ~2 GB | Yes | granite4.1:3b |
| Granite 4.1 8B Instruct | Granite | 8B | Q4_K_M | 8 GB | ~5.5 GB | Yes | granite4.1:8b |
| Qwen3.6 27B | Qwen | 27B | Q4_K_M | 32 GB | ~18 GB | Yes | qwen3.6:27b |
| Qwen3.8 27B | Qwen | 27B | Q4_K_M | 24 GB | ~16.5 GB | Yes | qwen3.8:27b |
| Qwen3.8 27B (Q8) | Qwen | 27B | Q8_0 | 48 GB | ~27.1 GB | Yes | qwen3.8:27b-q8_0 |
| Qwen3.6 35B-A3B | Qwen | 35B | Q4_K_M | 32 GB | ~22 GB | Yes | qwen3.6:35b-a3b |
| Gemma 4 31B | Gemma | 31B | Q4_K_M | 32 GB | ~20 GB | Yes | gemma4:31b |
| Gemma 4 31B (Q8) | Gemma | 31B | Q8_0 | 48 GB | ~30.9 GB | Yes | gemma4:31b-it-q8_0 |
| Gemma 4 26B-A4B | Gemma | 26B | Q4_K_M | 24 GB | ~16 GB | Yes | gemma4:26b |
| Gemma 4 E4B | Gemma | 4.5B | Q4_K_M | 6 GB | ~4 GB | Yes | gemma4:e4b |
| Gemma 4 E4B (Q8) | Gemma | 4.5B | Q8_0 | 16 GB | ~7.5 GB | Yes | gemma4:e4b-it-q8_0 |
| Gemma 4 E2B | Gemma | 2.3B | Q4_K_M | 4 GB | ~2.3 GB | Yes | gemma4:e2b |
| Gemma 4 E2B (Q8) | Gemma | 2.3B | Q8_0 | 8 GB | ~4.6 GB | Yes | gemma4:e2b-it-q8_0 |
| Llama 4 Scout | Llama | 109B | Q4_K_M | 96 GB | ~67 GB | Yes | llama4:scout |
| Llama 4 Maverick | Llama | 400B | Q4_K_M | 320 GB | ~245 GB | Yes | llama4:maverick |
| Mistral Medium 3.5 | Mistral | 128B | API | 0 GB | n/a | Open (llama.cpp) | n/a |
| Mistral Large 4 | Mistral | 1049B | API | 0 GB | n/a | Open, no fit | n/a |
| DeepSeek V4 Flash 0731 | DeepSeek | 284B | API | 0 GB | n/a | Open (llama.cpp) | n/a |
| DeepSeek V4 Pro | DeepSeek | 1600B | API | 0 GB | n/a | Open, no fit | n/a |
| DeepSeek V4.1 Flash | DeepSeek | 763.21B | API | 0 GB | n/a | Open, no fit | n/a |
| Kimi K2.6 | Kimi | 1000B | API | 0 GB | n/a | Open, no fit | n/a |
| GLM-5.1 | Zhipu | 744B | API | 0 GB | n/a | Open, no fit | n/a |
| Claude Opus 4.7 | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Claude Opus 4.8 | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| GPT-5.5 | OpenAI | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Gemini 3.1 Pro | Undisclosed | API | 0 GB | n/a | Cloud | n/a | |
| Grok 4.3 | xAI | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| Gemma 4 12B | Gemma | 12B | Q4_K_M | 12 GB | ~8 GB | Yes | gemma4:12b |
| Claude Fable 5 | Claude | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| GLM-5.2 | Zhipu | 753B | API | 0 GB | n/a | Open, no fit | n/a |
| Kimi K2.7-Code | Kimi | 1000B | API | 0 GB | n/a | Open, no fit | n/a |
| MiniMax M3 | MiniMax | 428B | API | 0 GB | n/a | Open, no fit | n/a |
| Qwen3.7-Plus | Qwen | Undisclosed | API | 0 GB | n/a | Cloud | n/a |
| NVIDIA Nemotron 3 Ultra | Nemotron | 550B | API | 0 GB | n/a | Open, no fit | n/a |
| Xiaomi MiMo-V2-Flash | MiMo | 309B | API | 0 GB | n/a | Open (llama.cpp) | n/a |
| NVIDIA Nemotron Cascade 2 30B-A3B | Nemotron | 30B | Q6_K | 36 GB | ~24 GB | Yes | nemotron-cascade-2:30b |
| Poolside Laguna XS.2 | Laguna | 33B | Q4_K_M | 36 GB | ~23 GB | Yes | laguna-xs.2:q4_K_M |
| Cohere North Mini Code | North | 30B | Q4_K_M | 32 GB | ~19 GB | Yes | north-mini-code-1.0:q4_K_M |
| GPT-OSS 120B | GPT-OSS | 117B | MXFP4 | 96 GB | ~65.4 GB | Yes | gpt-oss:120b |
| GPT-OSS 20B | GPT-OSS | 21B | MXFP4 | 24 GB | ~13.8 GB | Yes | gpt-oss:20b |
| Qwen3-Next 80B-A3B | Qwen | 80B | Q4_K_M | 72 GB | ~50.4 GB | Yes | qwen3-next:80b |
| Qwen3.6 35B-A3B (Q8) | Qwen | 35B | Q8_0 | 64 GB | ~38.7 GB | Yes | qwen3.6:35b-a3b-q8_0 |
| Qwen3.5 35B-A3B Instruct (Q8) | Qwen | 35B | Q8_0 | 64 GB | ~38.7 GB | Yes | qwen3.5:35b-a3b-q8_0 |
| Qwen3.5 9B Instruct (Q8) | Qwen | 9B | Q8_0 | 16 GB | ~10.7 GB | Yes | qwen3.5:9b-q8_0 |
| Qwen3.6 27B (Q8) | Qwen | 27B | Q8_0 | 48 GB | ~30 GB | Yes | qwen3.6:27b-q8_0 |
| Gemma 4 12B (Q8) | Gemma | 12B | Q8_0 | 24 GB | ~12.8 GB | Yes | gemma4:12b-it-q8_0 |
| Gemma 4 26B-A4B (Q8) | Gemma | 26B | Q8_0 | 48 GB | ~28.1 GB | Yes | gemma4:26b-a4b-it-q8_0 |
| Qwen3-Next 80B-A3B (Q8) | Qwen | 80B | Q8_0 | 128 GB | ~84.8 GB | Yes | qwen3-next:80b-a3b-instruct-q8_0 |
| Qwen3 14B (Q8) | Qwen | 14B | Q8_0 | 24 GB | ~15.9 GB | Yes | qwen3:14b-q8_0 |
| Llama 3.3 70B Instruct (Q8) | Llama | 70B | Q8_0 | 96 GB | ~75 GB | Yes | llama3.3:70b-instruct-q8_0 |
| Llama 3.3 70B Instruct (Q6) | Llama | 70B | Q6_K | 96 GB | ~57.9 GB | Yes | llama3.3:70b-instruct-q6_K |
| Kimi K3 | Kimi | 2800B | API | 0 GB | n/a | Open, no fit | n/a |
| Laguna XS 2.1 | Laguna | 33B | Q4_K_M | 32 GB | ~20.3 GB | Yes | laguna-xs-2.1:q4_K_M |
| Laguna S 2.1 | Laguna | 118B | Q4_K_M | 128 GB | ~96 GB | Yes | laguna-s-2.1:q4_K_M |
| Ornith 1.0 9B | Ornith | 9B | Q4_K_M | 8 GB | ~5.6 GB | Yes | ornith:9b |
| Ornith 1.0 35B | Ornith | 35B | Q4_K_M | 32 GB | ~21.2 GB | Yes | ornith:35b |
| Qwen3.8-Flash-Next | Qwen | 125B | Q4_K_XL | 192 GB | ~111.3 GB | Yes | n/a |
| Qwen3.8-Flash-Next (IQ4_XS) | Qwen | 125B | IQ4_XS | 128 GB | ~93.7 GB | Yes | n/a |
| Qwen3.8-Flash-Next (Q3) | Qwen | 125B | Q3_K_XL | 128 GB | ~90 GB | Yes | n/a |
| Qwen3.8 2.4T A95B | Qwen | 2400B | API | 0 GB | n/a | Open, no fit | n/a |
| Granite 4.2 3B | Granite | 3.7B | Q4_K_M | 4 GB | ~2.1 GB | Yes | granite4.2:3b |
| Granite 4.2 8B | Granite | 8.8B | Q4_K_M | 8 GB | ~5 GB | Yes | granite4.2:8b |
| Granite 4.2 30B | Granite | 29.3B | Q4_K_M | 24 GB | ~16.5 GB | Yes | granite4.2:30b |
| Nemotron 3.5 Lightning 30B-A3B | Nemotron | 30B | Q4_K_M | 36 GB | ~25.4 GB | Yes | nemotron-3.5-lightning:30b |
| Nemotron 3.5 Lightning 30B-A3B (IQ4_XS) | Nemotron | 30B | IQ4_XS | 32 GB | ~18.9 GB | Yes | n/a |
| Muse Glimmer 30B | Muse | 29.8B | Q4_K_M | 32 GB | ~16.9 GB | Yes | muse-glimmer:30b |
| MiniCPM-V 4.5 8B | MiniCPM | 8.7B | Q4_K_M | 12 GB | ~5.7 GB | Yes | minicpm-v4.5:8b |
| GLM-5.3 | Zhipu | 753B | API | 0 GB | n/a | Open, no fit | n/a |
| GLM-5.3 Flash | Zhipu | 321B | API | 0 GB | n/a | Open (llama.cpp) | n/a |
| GLM-4.7-Flash 30B-A3B | Zhipu | 30B | Q4_K_M | 32 GB | ~19 GB | Yes | glm-4.7-flash |
| GLM-4-9B-Chat | Zhipu | 9.4B | Q4_K_M | 12 GB | ~6.3 GB | Yes | glm4:9b-chat-q4_K_M |
| GLM-4-9B-Chat (Q8) | Zhipu | 9.4B | Q8_0 | 16 GB | ~10 GB | Yes | glm4:9b-chat-q8_0 |
| Nemotron 3 Super 120B-A12B | Nemotron | 120B | Q4_K_M | 128 GB | ~86.8 GB | Yes | nemotron-3-super:120b |
| Nemotron 3 Super 120B-A12B (IQ4_XS) | Nemotron | 120B | IQ4_XS | 96 GB | ~64.5 GB | Yes | n/a |
| Olmo 3.1 32B Instruct | Olmo | 32B | Q4_K_M | 32 GB | ~19.5 GB | Yes | olmo-3.1:32b |
| MiMo-V2.6-Distill-Qwen-9B | MiMo | 9B | Q4_K_M | 16 GB | ~5.8 GB | Yes | n/a |
| Ling-3.0-flash | Ling | 124B | Q4_K_M | 128 GB | ~77.8 GB | Yes | n/a |
| Ling-3.0-flash (IQ4_XS) | Ling | 124B | IQ4_XS | 96 GB | ~68.7 GB | Yes | n/a |
| Xiaomi MiMo-V2.6-Flash | MiMo | 309B | API | 0 GB | n/a | Open (llama.cpp) | n/a |
| Xiaomi MiMo-V2.6-Pro | MiMo | 1020B | API | 0 GB | n/a | Open, no fit | n/a |
| Devstral Small 2 24B | Mistral | 24B | Q4_K_M | 24 GB | ~15.2 GB | Yes | devstral-small-2:24b |
| Devstral 2 123B | Mistral | 123B | Q4_K_M | 96 GB | ~74.9 GB | Yes | devstral-2:123b |
| Ministral 3 3B | Mistral | 3.4B | Q4_K_M | 6 GB | ~3 GB | Yes | ministral-3:3b |
| Ministral 3 8B | Mistral | 8.4B | Q4_K_M | 12 GB | ~6 GB | Yes | ministral-3:8b |
| Ministral 3 14B | Mistral | 13.5B | Q4_K_M | 16 GB | ~9.1 GB | Yes | ministral-3:14b |
| Inkling Small | Inkling | 276B | API | 0 GB | n/a | Open (llama.cpp) | n/a |
| Flint 40B-A2.5B | Flint | 39.8B | NVFP4 | 36 GB | ~22.9 GB | Yes | flint:40b |
| Mellum2.1 12B-A2.5B Thinking | Mellum | 12.1B | Q4_K_M | 16 GB | ~8.1 GB | Yes | n/a |
| Kolibri 1 | Kolibri | 78.1B | Q4_K_M | 96 GB | ~49.8 GB | Yes | n/a |
| Kolibri 1 (IQ4_XS) | Kolibri | 78.1B | IQ4_XS | 64 GB | ~43.6 GB | Yes | n/a |
| AREX-2 27B | AREX | 27.4B | Q4_K_M | 32 GB | ~17.2 GB | Yes | n/a |
| Arete 27B | Arete | 27.4B | Q4_K_M | 32 GB | ~17.2 GB | Yes | n/a |
| TwIL-8B | TwIL | 8.79B | Q4_K_M | 8 GB | ~5.3 GB | Yes | n/a |
| Nanbeige4.3 33B | Nanbeige | 33.1B | Q4_K_M | 32 GB | ~20.8 GB | Yes | n/a |
| Nanbeige4.3 33B (Q8) | Nanbeige | 33.1B | Q8_0 | 64 GB | ~35.2 GB | Yes | n/a |
| Ripple 65B Preview | Ripple | 64.8B | Q4_K_M | 64 GB | ~38.8 GB | Yes | ripple-preview:65b-q4_K_M |
| Ripple 65B Preview (Q8) | Ripple | 64.8B | Q8_0 | 96 GB | ~68.8 GB | Yes | n/a |
| Muse Spark Open | Muse | 816B | API | 0 GB | n/a | Open, no fit | n/a |
| MiniMax M3.1 Flash | MiniMax | 428B | API | 0 GB | n/a | Open, no fit | n/a |
| MiniMax M3.1 Flash | MiniMax | 428B | Q4_K_XL | 512 GB | ~249.4 GB | Yes | n/a |
| MiniMax M3.1 Flash (Q3_K_XL) | MiniMax | 428B | Q3_K_XL | 256 GB | ~194 GB | Yes | n/a |
| Beam 1.0 | Beam | 501B | API | 0 GB | n/a | Open, no fit | n/a |
| NVIDIA Nemotron 3.5 Bolt E4B | Nemotron | 4B | Q4_K_M | 12 GB | ~7.9 GB | Yes | nemotron-3.5-bolt:e4b |
| Granite Switch 4.1 8B | Granite | 8.8B | Q4_K_M | 12 GB | ~6.4 GB | Yes | n/a |
| Granite Switch 4.1 30B | Granite | 30B | Q4_K_M | 32 GB | ~21 GB | Yes | n/a |
| Jebadiah 9B | Jebadiah | 9B | Q4_K_M | 12 GB | ~5.8 GB | Yes | n/a |
| Jebadiah 9B (Q5) | Jebadiah | 9B | Q5_K_M | 12 GB | ~6.6 GB | Yes | n/a |
| Jebadiah 9B (Q8) | Jebadiah | 9B | Q8_0 | 16 GB | ~9.8 GB | Yes | n/a |
| Jebadiah 27B | Jebadiah | 27B | Q4_K_M | 32 GB | ~16.8 GB | Yes | n/a |
| Jebadiah 27B (Q5) | Jebadiah | 27B | Q5_K_M | 32 GB | ~19.5 GB | Yes | n/a |
| Jebadiah 27B (Q8) | Jebadiah | 27B | Q8_0 | 48 GB | ~29 GB | Yes | n/a |
| LFM3 1.7B | LFM3 | 1.73B | Q4_K_M | 4 GB | ~1.1 GB | Yes | lfm3:1.7b |
| Ling-3.1-flash-1019 | Ling | 560B | Q4_K_M | 512 GB | ~358 GB | Yes | n/a |
| Tencent Hy4 Preview | Hy | 770B | IQ4_XS | 512 GB | ~417 GB | Yes | n/a |
| Ornith 1.5 122B | Ornith | 125.09B | Q4_K_M | 128 GB | ~75.8 GB | Yes | ornith-1.5:122b |
| Sage-A1.5 | Sage | 35.95B | Q4_K_M | 32 GB | ~21.7 GB | Yes | n/a |
How much RAM do you need?
Largest dense Q4 model that fits each memory tier
Full breakdown on the stats page.