Best Local LLMs for 32GB RAM

Ranked open-weight models that run well on a 32GB machine, with estimated speed and the exact ollama command for each.

Best local models for ~32GB

12 picks

Estimates assume a representative Apple-Silicon machine with 32GB unified memory. Tok/s are ModelFit estimates, not measured benchmarks. Run the wizard for figures tuned to your exact chip.

01

Gemma 4 26B-A4B

Gemma / 26B / Q4_K_M / ~16 GB

Best for: Chat, Coding, Multimodal·Perf: ~66.6 tok/s · first token ~0.6s

Runs well

Best for chat, coding, multimodal. Strong fit for 32 GB RAM with balanced speed and quality.

ollama
$ollama run gemma4:26b
02

Qwen3.8 27B

Qwen / 27B / Q4_K_M / ~16.5 GB

Best for: Coding, Agent, Vision, Long context·Perf: ~25.1 tok/s · first token ~0.8s

Runs well

Best for coding, agent, vision, long context. Strong fit for 32 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.8:27b
03

Qwen3.5 27B Instruct

Qwen / 27B / Q4_K_M / ~16 GB

Best for: Chat, Coding, Complex reasoning·Perf: ~25.1 tok/s · first token ~0.8s

Runs well

Best for chat, coding, complex reasoning. Strong fit for 32 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:27b
04

Qwen3.6 27B

Qwen / 27B / Q4_K_M / ~18 GB

Best for: Coding, Quality, Long context·Perf: ~25.1 tok/s · first token ~0.8s

Runs well

This model may feel memory-heavy on 32 GB RAM, but it is still listed for balanced speed and quality.

ollama
$ollama run qwen3.6:27b
05

GPT-OSS 20B

GPT-OSS / 21B / MXFP4 / ~13.8 GB

Best for: Chat, Coding, Reasoning·Perf: ~82.4 tok/s · first token ~0.6s

Runs well

Best for chat, coding, reasoning. Strong fit for 32 GB RAM with balanced speed and quality.

ollama
$ollama run gpt-oss:20b
06

LFM2 24B-A2B Instruct

LFM2 / 24B / Q4_K_M / ~14 GB

Best for: Local AI agents, privacy-first tool calling, MCP workflows·Perf: ~98 tok/s · first token ~0.6s

Runs well

Best for local ai agents, privacy-first tool calling, mcp workflows. Strong fit for 32 GB RAM with balanced speed and quality.

ollama
$ollama run lfm2:24b-a2b
07

Qwen3.6 35B-A3B

Qwen / 35B / Q4_K_M / ~22 GB

Best for: Reasoning, Coding, Agents·Perf: ~60.7 tok/s · first token ~1.4s

Runs well

This model may feel memory-heavy on 32 GB RAM, but it is still listed for balanced speed and quality.

ollama
$ollama run qwen3.6:35b-a3b
08

Qwen3.5 35B-A3B Instruct

Qwen / 35B / Q4_K_M / ~20 GB

Best for: Reasoning, Coding, Agent scenarios·Perf: ~66.3 tok/s · first token ~1.4s

Runs well

This model may feel memory-heavy on 32 GB RAM, but it is still listed for balanced speed and quality.

ollama
$ollama run qwen3.5:35b-a3b
09

Laguna XS 2.1

Laguna / 33B / Q4_K_M / ~20.3 GB

Best for: Agentic coding, Long-horizon tasks·Perf: ~67.8 tok/s · first token ~1.4s

Runs well

This model may feel memory-heavy on 32 GB RAM, but it is still listed for balanced speed and quality.

ollama
$ollama run laguna-xs-2.1:q4_K_M
10

Qwen3.5 9B Instruct

Qwen / 9B / Q4_K_M / ~7 GB

Best for: Quality, Coding, Reasoning·Perf: ~75.4 tok/s · first token ~0.6s

Perfect fit

Best for quality, coding, reasoning. Strong fit for 32 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:9b
11

Gemma 4 12B (Q8)

Gemma / 12B / Q8_0 / ~12.8 GB

Best for: Chat, Coding, Multimodal·Perf: ~31 tok/s · first token ~0.8s

Runs well

Best for chat, coding, multimodal. Strong fit for 32 GB RAM with balanced speed and quality.

ollama
$ollama run gemma4:12b-it-q8_0
12

Ornith 1.0 35B

Ornith / 35B / Q4_K_M / ~21.2 GB

Best for: Agentic coding·Perf: ~18.4 tok/s · first token ~1.8s

Runs well

This model may feel memory-heavy on 32 GB RAM, but it is still listed for balanced speed and quality.

ollama
$ollama run ornith:35b

Want an exact recommendation?

The wizard tunes picks and speed estimates to your exact device, chip, and RAM.

Best Local LLMs for 32GB RAM (2026) | ModelFit