Best Local LLMs for 512GB RAM

Ranked open-weight models that run well on a 512GB machine, with estimated speed and the exact ollama command for each.

Try: RTX 4090, MacBook Pro M4, 16GB, iPhone 17 Pro

Best local models for ~512GB

12 picks

Estimates assume a representative Apple-Silicon machine with 512GB unified memory. Tok/s are ModelFit estimates, not measured benchmarks. Run the wizard for figures tuned to your exact chip.

01

Llama 4 Maverick

Llama / 400B / Q4_K_M / ~245 GB

Best for: Frontier quality, Long context·Perf: ~8 tok/s · first token ~2.5s

Runs well

Best for frontier quality, long context. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run llama4:maverick
02

GPT-OSS 120B

GPT-OSS / 117B / MXFP4 / ~65.4 GB

Best for: Reasoning, Coding, Agents·Perf: ~28.6 tok/s · first token ~1.6s

Perfect fit

Best for reasoning, coding, agents. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run gpt-oss:120b
03

Laguna S 2.1

Laguna / 118B / Q4_K_M / ~96 GB

Best for: Agentic coding, Long-horizon tasks·Perf: ~21.5 tok/s · first token ~1.7s

Perfect fit

Best for agentic coding, long-horizon tasks. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run laguna-s-2.1:q4_K_M
04

Qwen3.5 122B-A10B Instruct

Qwen / 122B / Q4_K_M / ~72 GB

Best for: Frontier-level reasoning, Complex tasks·Perf: ~18.9 tok/s · first token ~1.8s

Perfect fit

Best for frontier-level reasoning, complex tasks. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:122b-a10b
05

Llama 4 Scout

Llama / 109B / Q4_K_M / ~67 GB

Best for: Long context, Quality, Multimodal·Perf: ~15.4 tok/s · first token ~1.9s

Perfect fit

Best for long context, quality, multimodal. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run llama4:scout
06

Qwen3.6 35B-A3B

Qwen / 35B / Q4_K_M / ~22 GB

Best for: Reasoning, Coding, Agents·Perf: ~64.6 tok/s · first token ~1.4s

Perfect fit

Best for reasoning, coding, agents. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.6:35b-a3b
07

Qwen3.5 35B-A3B Instruct

Qwen / 35B / Q4_K_M / ~20 GB

Best for: Reasoning, Coding, Agent scenarios·Perf: ~64.6 tok/s · first token ~1.4s

Perfect fit

Best for reasoning, coding, agent scenarios. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:35b-a3b
08

Qwen3 235B A22B

Qwen / 235B / Q4_K_M / ~130 GB

Best for: Quality, Reasoning·Perf: ~9.2 tok/s · first token ~2.3s

Perfect fit

Best for quality, reasoning. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3:235b-a22b-q4_K_M
09

Qwen3-Next 80B-A3B (Q8)

Qwen / 80B / Q8_0 / ~84.8 GB

Best for: Chat, Coding, Long Context·Perf: ~23.4 tok/s · first token ~1.7s

Perfect fit

Best for chat, coding, long context. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3-next:80b-a3b-instruct-q8_0
10

Gemma 4 26B-A4B

Gemma / 26B / Q4_K_M / ~16 GB

Best for: Chat, Coding, Multimodal·Perf: ~64.9 tok/s · first token ~0.6s

Perfect fit

Best for chat, coding, multimodal. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run gemma4:26b
11

Qwen3.5 4B Instruct

Qwen / 4B / Q4_K_M / ~3.5 GB

Best for: Coding, Agents, Multimodal·Perf: ~165.4 tok/s · first token ~0.5s

Perfect fit

Best for coding, agents, multimodal. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:4b
12

Qwen3.5 27B Instruct

Qwen / 27B / Q4_K_M / ~16 GB

Best for: Chat, Coding, Complex reasoning·Perf: ~24.5 tok/s · first token ~0.9s

Perfect fit

Best for chat, coding, complex reasoning. Strong fit for 512 GB RAM with balanced speed and quality.

ollama
$ollama run qwen3.5:27b

Browse by RAM tier

8 GB16 GB24 GB32 GB48 GB64 GB96 GB128 GB

Want an exact recommendation?

The wizard tunes picks and speed estimates to your exact device, chip, and RAM.

Open ModelFit Wizard Browse all devices