Best Local LLMs for 128GB RAM

Ranked open-weight models that run well on a 128GB machine, with estimated speed and the exact ollama command for each.

Best local models for ~128GB

12 picks

Estimates assume a representative Apple-Silicon machine with 128GB unified memory. Tok/s are ModelFit estimates, not measured benchmarks. Run the wizard for figures tuned to your exact chip.

01

GPT-OSS 120B

GPT-OSS / 117B / MXFP4 / ~65.4 GB

Best for: Reasoning, Coding, Agents·Perf: ~42.8 tok/s · first token ~1.5s

Runs well

Best for reasoning, coding, agents. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run gpt-oss:120b
02

Qwen3.5 122B-A10B Instruct

Qwen / 122B / Q4_K_M / ~72 GB

Best for: Frontier-level reasoning, Complex tasks·Perf: ~28.4 tok/s · first token ~1.6s

Runs well

Best for frontier-level reasoning, complex tasks. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:122b-a10b
03

Llama 4 Scout

Llama / 109B / Q4_K_M / ~67 GB

Best for: Long context, Quality, Multimodal·Perf: ~23.1 tok/s · first token ~1.7s

Runs well

Best for long context, quality, multimodal. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run llama4:scout
04

Qwen3-Next 80B-A3B (Q8)

Qwen / 80B / Q8_0 / ~84.8 GB

Best for: Chat, Coding, Long Context·Perf: ~35 tok/s · first token ~1.5s

Runs well

This model may feel memory-heavy on 128 GB RAM, but it is still listed for balanced speed and quality.

ollama
$ollama run qwen3-next:80b-a3b-instruct-q8_0
05

Qwen3-Next 80B-A3B

Qwen / 80B / Q4_K_M / ~50.4 GB

Best for: Chat, Coding, Long Context·Perf: ~64 tok/s · first token ~1.4s

Runs well

Best for chat, coding, long context. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3-next:80b
06

Laguna S 2.1

Laguna / 118B / Q4_K_M / ~96 GB

Best for: Agentic coding, Long-horizon tasks·Perf: ~32.3 tok/s · first token ~1.6s

Runs well

This model may feel memory-heavy on 128 GB RAM, but it is still listed for balanced speed and quality.

ollama
$ollama run laguna-s-2.1:q4_K_M
07

Qwen3.6 35B-A3B (Q8)

Qwen / 35B / Q8_0 / ~38.7 GB

Best for: Reasoning, Coding, Agents·Perf: ~53 tok/s · first token ~1.4s

Perfect fit

Best for reasoning, coding, agents. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.6:35b-a3b-q8_0
08

Qwen3.5 35B-A3B Instruct (Q8)

Qwen / 35B / Q8_0 / ~38.7 GB

Best for: Reasoning, Coding, Agent scenarios·Perf: ~53 tok/s · first token ~1.4s

Perfect fit

Best for reasoning, coding, agent scenarios. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:35b-a3b-q8_0
09

Qwen3.6 35B-A3B

Qwen / 35B / Q4_K_M / ~22 GB

Best for: Reasoning, Coding, Agents·Perf: ~96.8 tok/s · first token ~1.4s

Perfect fit

Best for reasoning, coding, agents. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.6:35b-a3b
10

Qwen3.5 35B-A3B Instruct

Qwen / 35B / Q4_K_M / ~20 GB

Best for: Reasoning, Coding, Agent scenarios·Perf: ~96.8 tok/s · first token ~1.4s

Perfect fit

Best for reasoning, coding, agent scenarios. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:35b-a3b
11

Qwen3.8 27B

Qwen / 27B / Q4_K_M / ~16.5 GB

Best for: Coding, Agent, Vision, Long context·Perf: ~36.8 tok/s · first token ~0.7s

Perfect fit

Best for coding, agent, vision, long context. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.8:27b
12

Qwen3.6 27B

Qwen / 27B / Q4_K_M / ~18 GB

Best for: Coding, Quality, Long context·Perf: ~36.8 tok/s · first token ~0.7s

Perfect fit

Best for coding, quality, long context. Strong fit for 128 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.6:27b

Want an exact recommendation?

The wizard tunes picks and speed estimates to your exact device, chip, and RAM.

Best Local LLMs for 128GB RAM (2026) | ModelFit