Best Local LLMs for 64GB RAM

Ranked open-weight models that run well on a 64GB machine, with estimated speed and the exact ollama command for each.

Ranked picks

Best local models for ~64GB

12 picks
  1. 01

    Qwen3.6 35B-A3B (Q8)

    Qwen / 35B / Q8_0 / ~38.7 GB

    This model may feel memory-heavy on 64 GB RAM, but it is still listed for balanced speed and quality.

    ollama
    $ollama run qwen3.6:35b-a3b-q8_0
    Fit
    Runs wellC · 19
    Best for
    Reasoning, Coding, Agents
    Perf
    est. 99 tok/s, typical error 10% · first token ~0.4s
  2. 02

    Nemotron 3.5 Lightning 30B-A3B

    Nemotron / 30B / Q4_K_M / ~25.4 GB

    Best for agentic, coding, long context. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run nemotron-3.5-lightning:30b
    Fit
    Runs wellB · 47
    Best for
    Agentic, Coding, Long context
    Perf
    est. 99 tok/s, typical error 10% · first token ~0.5s
  3. 03

    Gemma 4 26B-A4B (Q8)

    Gemma / 26B / Q8_0 / ~28.1 GB

    Best for chat, coding, multimodal. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run gemma4:26b-a4b-it-q8_0
    Fit
    Runs wellB · 41
    Best for
    Chat, Coding, Multimodal
    Perf
    est. 76 tok/s, typical error 10% · first token ~0.5s
  4. 04

    Kolibri 1 (IQ4_XS)

    Kolibri / 78.1B / IQ4_XS / ~43.6 GB

    This model may feel memory-heavy on 64 GB RAM, but it is still listed for balanced speed and quality.

    ollama
    $ollama run kolibri-1-q4xs
    Fit
    Runs wellC · 9
    Best for
    Reasoning, German, Long context
    Perf
    est. 121 tok/s, typical error 10% · first token ~0.5s
  5. 05

    Qwen3.6 35B-A3B

    Qwen / 35B / Q4_K_M / ~22 GB

    Best for reasoning, coding, agents. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run qwen3.6:35b-a3b
    Fit
    Runs wellB · 54
    Best for
    Reasoning, Coding, Agents
    Perf
    est. 139 tok/s, typical error 10% · first token ~0.4s
  6. 06

    Qwen3.8 27B (Q8)

    Qwen / 27B / Q8_0 / ~27.1 GB

    Best for coding, agent, vision, long context. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run qwen3.8:27b-q8_0
    Fit
    Runs wellB · 44
    Best for
    Coding, Agent, Vision, Long context
    Perf
    est. 21 tok/s, typical error 10% · first token ~3.4s
  7. 07

    Qwen3.8 27B

    Qwen / 27B / Q4_K_M / ~16.5 GB

    Best for coding, agent, vision, long context. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run qwen3.8:27b
    Fit
    Lots of roomA · 66
    Best for
    Coding, Agent, Vision, Long context
    Perf
    est. 34 tok/s, typical error 10% · first token ~3.3s
  8. 08

    Gemma 4 26B-A4B

    Gemma / 26B / Q4_K_M / ~16 GB

    Best for chat, coding, multimodal. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run gemma4:26b
    Fit
    Lots of roomA · 67
    Best for
    Chat, Coding, Multimodal
    Perf
    est. 103 tok/s, typical error 10% · first token ~0.4s
  9. 09

    NVIDIA Nemotron Cascade 2 30B-A3B

    Nemotron / 30B / Q6_K / ~24 GB

    Best for reasoning, math, agentic tasks. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run nemotron-cascade-2:30b
    Fit
    Runs wellB · 50
    Best for
    Reasoning, Math, Agentic tasks
    Perf
    est. 102 tok/s, typical error 10% · first token ~0.7s
  10. 10

    Gemma 4 31B (Q8)

    Gemma / 31B / Q8_0 / ~30.9 GB

    Best for quality, coding, multimodal. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run gemma4:31b-it-q8_0
    Fit
    Runs wellB · 36
    Best for
    Quality, Coding, Multimodal
    Perf
    est. 17 tok/s, typical error 10% · first token ~4.2s
  11. 11

    Nemotron 3.5 Lightning 30B-A3B (IQ4_XS)

    Nemotron / 30B / IQ4_XS / ~18.9 GB

    Best for agentic, coding, long context. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run nemotron-3.5-lightning-30b-q4xs
    Fit
    Lots of roomA · 61
    Best for
    Agentic, Coding, Long context
    Perf
    est. 120 tok/s, typical error 10% · first token ~0.5s
  12. 12

    Gemma 4 31B

    Gemma / 31B / Q4_K_M / ~20 GB

    Best for quality, coding, multimodal. Strong fit for 64 GB RAM with balanced speed and quality.

    ollama
    $ollama run gemma4:31b
    Fit
    Runs wellB · 58
    Best for
    Quality, Coding, Multimodal
    Perf
    est. 28 tok/s, typical error 10% · first token ~4.0s

Browse by RAM tier

Want an exact recommendation?

The wizard tunes picks and speed estimates to your exact device, chip, and RAM.

Best Local LLMs for 64GB RAM (2026) | ModelFit