Local LLM Leaderboard: What Your Machine Runs vs GPT-4 and GPT-5

A 16 GB MacBook Air (M5) runs Qwen3.5 9B, which scores 139.5 on the Epoch Capabilities Index: GPT-4.5 (Feb 2025) class, and above GPT-4 (Mar 2023) and GPT-4o (May 2024). Every local model ModelFit tracks, scored on one cross-era scale with the famous cloud models as reference lines.

ECI data 2026-10-13 · LMArena 2026-10-08
Key facts

A 16 GB MacBook Air (M5) runs Qwen3.5 9B, which scores 139.5 on the Epoch Capabilities Index: GPT-4.5 (Feb 2025) class, and above GPT-4 (Mar 2023) and GPT-4o (May 2024). The highest-scoring model that runs on a single machine is Qwen3.8 27B (ECI 149.4, needs 24 GB): above Gemini 2.5 Pro (Jun 2025).

$ ollama run qwen3.5:9b

Scores are for full-precision or API runs, from Epoch AI and LMArena. ModelFit runs no benchmarks.

MODELS RANKED
10844 with an ECI score
BEST ON A 16 GB MAC
Qwen3.5 9BECI 139.5, GPT-4.5 (Feb 2025) class
BEST OPEN WEIGHTS
Kimi K3ECI 157.4, datacenter-class
TOP CLOUD MODEL
Claude Opus 5.5ECI 167.3, Anthropic

What can your machine match?

Pick your Mac, iPhone or GPU. The ModelFit engine lists every model that fits, and this shows the one with the highest Epoch Capabilities Index score, next to the famous cloud model it matches.

Pick your machine
Your machine:
Best benchmarked model for MacBook Air M5 16 GB

Qwen3.5 9B

ECI 139.5 (range 136.3 to 141.5)

GPT-4.5 (Feb 2025) class

Next step up: o1 (Dec 2024), ECI 141.9

ollama run qwen3.5:9b

Score of the full-precision model. The Q4 build you run may score lower.

When did each Mac size catch GPT-4?

Epoch Capabilities Index

Each dot is an open-weight model at its release date, colored by the memory it needs. The lines are the famous cloud models: anything above a line scores higher than that model did.

When local models caught up with cloud models, by RAM neededScatter chart of 44 local models in ModelFit's catalog. Horizontal axis: model release date, Jul 2024 to Sep 2026. Vertical axis: Epoch Capabilities Index, from 102.0 to 157.4. Each dot is a model, colored by the minimum RAM of its smallest quant (8 GB, 16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 512 GB, Rig). Horizontal reference lines mark cloud models: GPT-3.5 Turbo (Nov 2023) at 118.5, GPT-4 (Mar 2023) at 125.9, GPT-4o (May 2024) at 129.0, o1 (Dec 2024) at 141.9, GPT-5 (Aug 2025) at 150.0, Claude Opus 5.5 at 167.3.100110120130140150160170Epoch Capabilities Index2023Jul2024Jul2025Jul2026JulGPT-3.5 Turbo (Nov 2023): ECI 118.5, released Nov 2023. Reference line from its release date.GPT-4 (Mar 2023): ECI 125.9, released Mar 2023. Reference line from its release date.GPT-4 Turbo (Apr 2024): ECI 127.3, released Apr 2024. Reference line from its release date.Claude 3 Opus (Feb 2024): ECI 126.9, released Feb 2024. Reference line from its release date.GPT-4o (May 2024): ECI 129.0, released May 2024. Reference line from its release date.Claude 3.5 Sonnet (Jun 2024): ECI 130.0, released Jun 2024. Reference line from its release date.o1 (Dec 2024): ECI 141.9, released Dec 2024. Reference line from its release date.GPT-4.5 (Feb 2025): ECI 136.7, released Feb 2025. Reference line from its release date.GPT-5 (Aug 2025): ECI 150.0, released Aug 2025. Reference line from its release date.Gemini 2.5 Pro (Jun 2025): ECI 145.3, released Jun 2025. Reference line from its release date.Claude Opus 4 (May 2025): ECI 142.7, released May 2025. Reference line from its release date.Claude Opus 5.5: ECI 167.3, released Sep 2026. Reference line from its release date.GPT-3.5 Turbo (Nov 2023): ECI 118.5GPT-3.5 Turbo (Nov 2023)GPT-4 (Mar 2023): ECI 125.9GPT-4 (Mar 2023)GPT-4o (May 2024): ECI 129.0GPT-4o (May 2024)o1 (Dec 2024): ECI 141.9o1 (Dec 2024)GPT-5 (Aug 2025): ECI 150.0GPT-5 (Aug 2025)Claude Opus 5.5: ECI 167.3Claude Opus 5.5DeepSeek-V3-0324: ECI 135.9, released Mar 2025, datacenter-class open weights, no single-machine fitKimi K2 Instruct: ECI 140.1, released Jul 2025, datacenter-class open weights, no single-machine fitGLM-5: ECI 145.8, released Feb 2026, datacenter-class open weights, no single-machine fitGLM-5.1: ECI 149.8, released Apr 2026, datacenter-class open weights, no single-machine fitKimi K2.6: ECI 151.1, released Apr 2026, datacenter-class open weights, no single-machine fitDeepSeek V4 Pro: ECI 149.1, released Apr 2026, datacenter-class open weights, no single-machine fitMistral Medium 3.5: ECI 141.3, released Apr 2026, datacenter-class open weights, no single-machine fitMiniMax M3: ECI 146.9, released Jun 2026, datacenter-class open weights, no single-machine fitNVIDIA Nemotron 3 Ultra: ECI 146.2, released Jun 2026, datacenter-class open weights, no single-machine fitKimi K2.7-Code: ECI 150.0, released Jun 2026, datacenter-class open weights, no single-machine fitGLM-5.2: ECI 151.8, released Jun 2026, datacenter-class open weights, no single-machine fitInkling Small: ECI 150.2, released Jul 2026, datacenter-class open weights, no single-machine fitKimi K3: ECI 157.4, released Jul 2026, datacenter-class open weights, no single-machine fitDeepSeek V4 Flash 0731: ECI 154.5, released Jul 2026, datacenter-class open weights, no single-machine fitGLM-5.3: ECI 155.6, released Aug 2026, datacenter-class open weights, no single-machine fitGLM-5.3 Flash: ECI 151.9, released Aug 2026, datacenter-class open weights, no single-machine fitDeepSeek V4.1 Flash: ECI 154.9, released Sep 2026, datacenter-class open weights, no single-machine fitDeepSeek-R1: ECI 139.0, released Jan 2025, needs 512 GB RAM (smallest quant)Llama 4 Maverick: ECI 132.2, released Apr 2025, needs 320 GB RAM (smallest quant)Qwen3 235B A22B: ECI 139.3, released Apr 2025, needs 192 GB RAM (smallest quant)Llama 4 Scout: ECI 129.6, released Apr 2025, needs 96 GB RAM (smallest quant)GPT-OSS 120B: ECI 139.9, released Aug 2025, needs 96 GB RAM (smallest quant)Llama 3.1 70B: ECI 125.9, released Jul 2024, needs 64 GB RAM (smallest quant)Llama 3.3 70B: ECI 127.3, released Dec 2024, needs 64 GB RAM (smallest quant)Gemma 3 27B: ECI 130.0, released Mar 2025, needs 32 GB RAM (smallest quant)Qwen3 30B-A3B: ECI 136.2, released Apr 2025, needs 32 GB RAM (smallest quant)Qwen3.5 35B-A3B: ECI 142.5, released Feb 2026, needs 32 GB RAM (smallest quant)Gemma 4 31B: ECI 142.7, released Apr 2026, needs 32 GB RAM (smallest quant)Qwen3.6 35B-A3B: ECI 143.9, released Apr 2026, needs 32 GB RAM (smallest quant)Qwen3.6 27B: ECI 146.5, released Apr 2026, needs 32 GB RAM (smallest quant)Phi-4 14B: ECI 130.4, released Dec 2024, needs 24 GB RAM (smallest quant)Mistral Small 3.1: ECI 127.5, released Mar 2025, needs 24 GB RAM (smallest quant)GPT-OSS 20B: ECI 137.8, released Aug 2025, needs 24 GB RAM (smallest quant)Gemma 4 26B-A4B: ECI 141.8, released Apr 2026, needs 24 GB RAM (smallest quant)Qwen3.8 27B: ECI 149.4, released Aug 2026, needs 24 GB RAM (smallest quant)Llama 3.1 8B: ECI 116.6, released Jul 2024, needs 12 GB RAM (smallest quant)DeepSeek-R1 Distill Qwen 14B: ECI 135.4, released Jan 2025, needs 16 GB RAM (smallest quant)Gemma 3 12B: ECI 123.5, released Mar 2025, needs 16 GB RAM (smallest quant)Qwen3 8B: ECI 136.2, released Apr 2025, needs 12 GB RAM (smallest quant)Qwen3 14B: ECI 138.2, released Apr 2025, needs 16 GB RAM (smallest quant)Qwen3.5 9B: ECI 139.5, released Feb 2026, needs 12 GB RAM (smallest quant)Qwen2.5 7B: ECI 118.5, released Sep 2024, needs 8 GB RAM (smallest quant)Llama 3.2 1B: ECI 102.0, released Sep 2024, needs 2 GB RAM (smallest quant)Gemma 3 4B: ECI 116.0, released Mar 2025, needs 6 GB RAM (smallest quant)When local models caught up with cloud models, by RAM neededScatter chart of 44 local models in ModelFit's catalog. Horizontal axis: model release date, Jul 2024 to Sep 2026. Vertical axis: Epoch Capabilities Index, from 102.0 to 157.4. Each dot is a model, colored by the minimum RAM of its smallest quant (8 GB, 16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 512 GB, Rig). Horizontal reference lines mark cloud models: GPT-3.5 Turbo (Nov 2023) at 118.5, GPT-4 (Mar 2023) at 125.9, GPT-4o (May 2024) at 129.0, o1 (Dec 2024) at 141.9, GPT-5 (Aug 2025) at 150.0, Claude Opus 5.5 at 167.3.100110120130140150160170Epoch Capabilities Index2023202420252026GPT-3.5 Turbo (Nov 2023): ECI 118.5, released Nov 2023. Reference line from its release date.GPT-4 (Mar 2023): ECI 125.9, released Mar 2023. Reference line from its release date.GPT-4 Turbo (Apr 2024): ECI 127.3, released Apr 2024. Reference line from its release date.Claude 3 Opus (Feb 2024): ECI 126.9, released Feb 2024. Reference line from its release date.GPT-4o (May 2024): ECI 129.0, released May 2024. Reference line from its release date.Claude 3.5 Sonnet (Jun 2024): ECI 130.0, released Jun 2024. Reference line from its release date.o1 (Dec 2024): ECI 141.9, released Dec 2024. Reference line from its release date.GPT-4.5 (Feb 2025): ECI 136.7, released Feb 2025. Reference line from its release date.GPT-5 (Aug 2025): ECI 150.0, released Aug 2025. Reference line from its release date.Gemini 2.5 Pro (Jun 2025): ECI 145.3, released Jun 2025. Reference line from its release date.Claude Opus 4 (May 2025): ECI 142.7, released May 2025. Reference line from its release date.Claude Opus 5.5: ECI 167.3, released Sep 2026. Reference line from its release date.GPT-3.5 Turbo (Nov 2023): ECI 118.5GPT-3.5 TurboGPT-4 (Mar 2023): ECI 125.9GPT-4GPT-4o (May 2024): ECI 129.0GPT-4oo1 (Dec 2024): ECI 141.9o1GPT-5 (Aug 2025): ECI 150.0GPT-5Claude Opus 5.5: ECI 167.3Claude Opus 5.5DeepSeek-V3-0324: ECI 135.9, released Mar 2025, datacenter-class open weights, no single-machine fitKimi K2 Instruct: ECI 140.1, released Jul 2025, datacenter-class open weights, no single-machine fitGLM-5: ECI 145.8, released Feb 2026, datacenter-class open weights, no single-machine fitGLM-5.1: ECI 149.8, released Apr 2026, datacenter-class open weights, no single-machine fitKimi K2.6: ECI 151.1, released Apr 2026, datacenter-class open weights, no single-machine fitDeepSeek V4 Pro: ECI 149.1, released Apr 2026, datacenter-class open weights, no single-machine fitMistral Medium 3.5: ECI 141.3, released Apr 2026, datacenter-class open weights, no single-machine fitMiniMax M3: ECI 146.9, released Jun 2026, datacenter-class open weights, no single-machine fitNVIDIA Nemotron 3 Ultra: ECI 146.2, released Jun 2026, datacenter-class open weights, no single-machine fitKimi K2.7-Code: ECI 150.0, released Jun 2026, datacenter-class open weights, no single-machine fitGLM-5.2: ECI 151.8, released Jun 2026, datacenter-class open weights, no single-machine fitInkling Small: ECI 150.2, released Jul 2026, datacenter-class open weights, no single-machine fitKimi K3: ECI 157.4, released Jul 2026, datacenter-class open weights, no single-machine fitDeepSeek V4 Flash 0731: ECI 154.5, released Jul 2026, datacenter-class open weights, no single-machine fitGLM-5.3: ECI 155.6, released Aug 2026, datacenter-class open weights, no single-machine fitGLM-5.3 Flash: ECI 151.9, released Aug 2026, datacenter-class open weights, no single-machine fitDeepSeek V4.1 Flash: ECI 154.9, released Sep 2026, datacenter-class open weights, no single-machine fitDeepSeek-R1: ECI 139.0, released Jan 2025, needs 512 GB RAM (smallest quant)Llama 4 Maverick: ECI 132.2, released Apr 2025, needs 320 GB RAM (smallest quant)Qwen3 235B A22B: ECI 139.3, released Apr 2025, needs 192 GB RAM (smallest quant)Llama 4 Scout: ECI 129.6, released Apr 2025, needs 96 GB RAM (smallest quant)GPT-OSS 120B: ECI 139.9, released Aug 2025, needs 96 GB RAM (smallest quant)Llama 3.1 70B: ECI 125.9, released Jul 2024, needs 64 GB RAM (smallest quant)Llama 3.3 70B: ECI 127.3, released Dec 2024, needs 64 GB RAM (smallest quant)Gemma 3 27B: ECI 130.0, released Mar 2025, needs 32 GB RAM (smallest quant)Qwen3 30B-A3B: ECI 136.2, released Apr 2025, needs 32 GB RAM (smallest quant)Qwen3.5 35B-A3B: ECI 142.5, released Feb 2026, needs 32 GB RAM (smallest quant)Gemma 4 31B: ECI 142.7, released Apr 2026, needs 32 GB RAM (smallest quant)Qwen3.6 35B-A3B: ECI 143.9, released Apr 2026, needs 32 GB RAM (smallest quant)Qwen3.6 27B: ECI 146.5, released Apr 2026, needs 32 GB RAM (smallest quant)Phi-4 14B: ECI 130.4, released Dec 2024, needs 24 GB RAM (smallest quant)Mistral Small 3.1: ECI 127.5, released Mar 2025, needs 24 GB RAM (smallest quant)GPT-OSS 20B: ECI 137.8, released Aug 2025, needs 24 GB RAM (smallest quant)Gemma 4 26B-A4B: ECI 141.8, released Apr 2026, needs 24 GB RAM (smallest quant)Qwen3.8 27B: ECI 149.4, released Aug 2026, needs 24 GB RAM (smallest quant)Llama 3.1 8B: ECI 116.6, released Jul 2024, needs 12 GB RAM (smallest quant)DeepSeek-R1 Distill Qwen 14B: ECI 135.4, released Jan 2025, needs 16 GB RAM (smallest quant)Gemma 3 12B: ECI 123.5, released Mar 2025, needs 16 GB RAM (smallest quant)Qwen3 8B: ECI 136.2, released Apr 2025, needs 12 GB RAM (smallest quant)Qwen3 14B: ECI 138.2, released Apr 2025, needs 16 GB RAM (smallest quant)Qwen3.5 9B: ECI 139.5, released Feb 2026, needs 12 GB RAM (smallest quant)Qwen2.5 7B: ECI 118.5, released Sep 2024, needs 8 GB RAM (smallest quant)Llama 3.2 1B: ECI 102.0, released Sep 2024, needs 2 GB RAM (smallest quant)Gemma 3 4B: ECI 116.0, released Mar 2025, needs 6 GB RAM (smallest quant)
  • Minimum RAM
  • 8 GB
  • 16 GB
  • 24 GB
  • 32 GB
  • 64 GB
  • 128 GB
  • 512 GB
  • Rig (datacenter class)
In ModelFit's catalog, the earliest model that fits each memory size and reaches GPT-4 (Mar 2023) class or above:
  • 16 GB: GPT-4 (Mar 2023) class since Jan 2025 (DeepSeek-R1 Distill Qwen 14B)
  • 24 GB: GPT-4 (Mar 2023) class since Dec 2024 (Phi-4 14B)
  • 32 GB: GPT-4 (Mar 2023) class since Dec 2024 (Phi-4 14B)
Scores are for full-precision runs; the quantized build that fits may score lower.

Data: Epoch AI, ECI (CC BY 4.0)

Every local model, ranked

ECI 2026-10-13 · LMArena 2026-10-08

44 of 44 models, 64 without an ECI score yet.

ModelECIClassLMArena (human preference)SWE-Bench VerifiedMin RAMRun
Today's top cloud model: Claude Opus 5.5 · ECI 167.3
Kimi K3datacenter-class
157.4155.2 to 160.0
Above GPT-5 (Aug 2025)147693.4%
Datacenter
GLM-5.3datacenter-class
155.6153.6 to 157.9
Above GPT-5 (Aug 2025)147195.4%
Datacenter
DeepSeek V4.1 Flashdatacenter-class
154.9148.5 to 157.3
GPT-5 (Aug 2025) class1462
Datacenter
DeepSeek V4 Flash 0731datacenter-class
154.5152.1 to 156.3
Above GPT-5 (Aug 2025)88.8%
Datacenter
GLM-5.3 Flashdatacenter-class
151.9149.6 to 153.9
GPT-5 (Aug 2025) class147192.0%
Datacenter
GLM-5.2datacenter-class
151.8149.8 to 153.8
GPT-5 (Aug 2025) class147082.8%
Datacenter
Kimi K2.6datacenter-class
151.1149.3 to 152.8
GPT-5 (Aug 2025) class1455
Datacenter
Inkling Smalldatacenter-class
150.2147.4 to 152.0
GPT-5 (Aug 2025) class141482.2%
Datacenter
GPT-5 (Aug 2025) · ECI 150.0
Kimi K2.7-Codedatacenter-class
150.0147.9 to 151.5
Above Gemini 2.5 Pro (Jun 2025)78.2%
Datacenter
GLM-5.1datacenter-class
149.8147.9 to 151.4
Above Gemini 2.5 Pro (Jun 2025)1461
Datacenter
149.4147.3 to 151.1
Above Gemini 2.5 Pro (Jun 2025)144186.0%
Q4 24 GBQ8 48 GB
$ qwen3.8:27b
DeepSeek V4 Prodatacenter-class
149.1147.3 to 150.7
Above Gemini 2.5 Pro (Jun 2025)145177.4%
Datacenter
MiniMax M3datacenter-class
146.9142.6 to 149.4
Gemini 2.5 Pro (Jun 2025) class143375.0%
Datacenter
146.5144.3 to 147.7
Gemini 2.5 Pro (Jun 2025) class77.2%
Q4 32 GBQ8 48 GB
$ qwen3.6:27b
NVIDIA Nemotron 3 Ultradatacenter-class
146.2143.9 to 148.0
Gemini 2.5 Pro (Jun 2025) class144569.0%
Datacenter
GLM-5datacenter-class
145.8143.8 to 147.7
Gemini 2.5 Pro (Jun 2025) class1446
Datacenter
Gemini 2.5 Pro (Jun 2025) · ECI 145.3
143.9141.2 to 145.9
Claude Opus 4 (May 2025) class73.4%
Q4 32 GBQ8 64 GB
$ qwen3.6:35b-a3b
142.7140.3 to 145.1
Claude Opus 4 (May 2025) class1443
Q4 32 GBQ8 48 GB
$ gemma4:31b
Claude Opus 4 (May 2025) · ECI 142.7
142.5140.3 to 144.8
o1 (Dec 2024) class1394
Q4 32 GBQ8 64 GB
$ qwen3.5:35b-a3b
o1 (Dec 2024) · ECI 141.9
141.8138.7 to 143.4
Above GPT-4.5 (Feb 2025)1434
Q4 24 GBQ8 48 GB
$ gemma4:26b
Mistral Medium 3.5datacenter-class
141.3138.6 to 143.2
GPT-4.5 (Feb 2025) class142166.4%
Datacenter
Kimi K2 Instructdatacenter-class
140.1136.6 to 142.0
GPT-4.5 (Feb 2025) class1371
Datacenter
139.9135.2 to 142.8
GPT-4.5 (Feb 2025) class1365
MXFP4 96 GB
$ gpt-oss:120b
139.5136.3 to 141.5
GPT-4.5 (Feb 2025) class
Q4 12 GBQ8 16 GB
$ qwen3.5:9b
139.3135.5 to 140.8
GPT-4.5 (Feb 2025) class1366
Q4 192 GB
$ qwen3:235b-a22b-q4_K_M
139.0136.3 to 140.3
GPT-4.5 (Feb 2025) class1373
Q4 512 GB
$ deepseek-r1:671b-q4_K_M
138.2133.7 to 140.0
GPT-4.5 (Feb 2025) class
Q4 16 GBQ8 24 GB
$ qwen3:14b-q4_K_M
137.8132.9 to 139.6
GPT-4.5 (Feb 2025) class1287
MXFP4 24 GB
$ gpt-oss:20b
GPT-4.5 (Feb 2025) · ECI 136.7
136.2129.7 to 138.6
Claude 3.5 Sonnet (Jun 2024) class1317
Q4 32 GBQ8 48 GB
$ qwen3:30b-a3b-q4_K_M
136.2130.1 to 138.2
Above Claude 3.5 Sonnet (Jun 2024)
Q4 12 GBQ8 16 GB
$ qwen3:8b-q4_K_M
DeepSeek-V3-0324datacenter-class
135.9132.1 to 137.8
Above Claude 3.5 Sonnet (Jun 2024)1375
Datacenter
135.4127.0 to 138.0
Claude 3.5 Sonnet (Jun 2024) class
Q4 16 GBQ8 24 GB
$ deepseek-r1:14b
132.2127.7 to 134.3
Claude 3.5 Sonnet (Jun 2024) class1287
Q4 320 GB
$ llama4:maverick
130.4124.7 to 132.0
Claude 3.5 Sonnet (Jun 2024) class1217
Q4 24 GBQ8 24 GB
$ phi4:14b-q4_K_M
130.0124.3 to 132.2
Claude 3.5 Sonnet (Jun 2024) class1358
Q4 32 GB
$ gemma3:27b
Claude 3.5 Sonnet (Jun 2024) · ECI 130.0
129.6124.3 to 131.4
GPT-4o (May 2024) class1279
Q4 96 GB
$ llama4:scout
GPT-4o (May 2024) · ECI 129.0
127.5122.2 to 129.3
GPT-4 Turbo (Apr 2024) class1277
Q4 24 GBQ8 36 GB
$ mistral-small3.1:24b
127.3121.8 to 129.7
GPT-4 Turbo (Apr 2024) class1274
Q4 64 GBQ8 96 GBQ6 96 GB
$ llama3.3:70b-instruct-q4_K_M
GPT-4 Turbo (Apr 2024) · ECI 127.3
Claude 3 Opus (Feb 2024) · ECI 126.9
125.9120.0 to 128.5
GPT-4 (Mar 2023) class1261
Q4 64 GB
$ llama3.1:70b-instruct-q4_K_M
GPT-4 (Mar 2023) · ECI 125.9
123.5116.0 to 128.5
GPT-3.5 Turbo (Nov 2023) class1334
Q4 16 GB
$ gemma3:12b
GPT-3.5 Turbo (Nov 2023) · ECI 118.5
118.5110.9 to 121.2
Q4 8 GB
$ qwen2.5:7b-instruct-q4_K_M
116.6106.2 to 121.1
1187
Q4 12 GBQ5 12 GBQ8 16 GB
$ llama3.1:8b-instruct-q4_K_M
116.097.6 to 123.8
1291
Q4 6 GBQ8 8 GB
$ gemma3:4b
102.090.0 to 110.1
1055
Q4 2 GB
$ llama3.2:1b-instruct-q4_K_M
No ECI score yet (64)

These models have no Epoch Capabilities Index score yet. Some have an LMArena rating, shown in its column.

ModelECIClassLMArena (human preference)SWE-Bench VerifiedMin RAMRun
Xiaomi MiMo-V2.6-Prodatacenter-class
1492
Datacenter
Xiaomi MiMo-V2.6-Flashdatacenter-class
1455
Datacenter
1417
Q4 96 GB
$ qwen3.5:122b-a10b
140975.0%
Q4 24 GBQ8 48 GB
$ qwen3.5:27b
1378
Q4 128 GB
$ nemotron-3-super:120b
1361
Q4 24 GB
$ granite4.2:30b
1351
Q4 32 GB
$ glm-4.7-flash
DeepSeek-V3datacenter-class
1332
Datacenter
1327
Q4 36 GB
$ nemotron-3.5-lightning:30b
1320
Q4 8 GB
$ granite4.2:8b
1311
Q4 32 GB
$ olmo-3.1:32b
1293
Q4 4 GB
$ granite4.2:3b
1290
Q4 8 GB
$ granite4.1:8b
1284
Q4 320 GB
$ llama3.1:405b-instruct-q4_K_M
1231
Q4 32 GB
$ gemma2:27b-instruct-q4_K_M
1207
Q4 12 GB
$ gemma2:9b-instruct-q4_K_M
1156
Q4 4 GB
$ gemma2:2b-instruct-q4_K_M
1138
Q4 16 GB
$ phi3:14b-medium-4k-instruct-q4_K_M
1132
Q4 48 GB
$ mixtral:8x7b
1110
Q4 4 GB
$ llama3.2:3b-instruct-q4_K_M
Q4 32 GB
$ north-mini-code-1.0:q4_K_M
Q4 64 GB
$ deepseek-r1:70b
Q4 8 GBQ8 16 GB
$ deepseek-r1:7b
Q4 96 GB
$ devstral-2:123b
Q4 24 GB
$ devstral-small-2:24b
Q4 2 GBQ8 4 GB
$ gemma3:1b
Q4 12 GBQ8 24 GB
$ gemma4:12b
Q4 4 GBQ8 8 GB
$ gemma4:e2b
Q4 6 GBQ8 16 GB
$ gemma4:e4b
Q4 4 GB
$ granite4.1:3b
Q4 128 GB
$ laguna-s-2.1:q4_K_M
Q4 32 GB
$ laguna-xs-2.1:q4_K_M
Q4 24 GB
$ lfm2:24b-a2b
Q4 8 GB
$ lfm2.5:8b-a1b-q4_K_M
Q4 128 GB
Q4 16 GB
Q4 12 GB
$ minicpm-v4.5:8b
Q4 16 GB
$ ministral-3:14b
Q4 6 GB
$ ministral-3:3b
Q4 12 GB
$ ministral-3:8b
Q4 8 GBQ5 8 GBQ8 16 GB
$ mistral:7b-instruct-v0.3-q4_K_M
Q4 16 GBQ8 24 GB
$ mistral-nemo:12b
Q4 32 GB
$ mistral-small:22b
Q4 32 GB
$ muse-glimmer:30b
Q6 36 GB
$ nemotron-cascade-2:30b
Q4 32 GB
$ ornith:35b
Q4 8 GB
$ ornith:9b
Q4 6 GB
$ phi3:3.8b-mini-4k-instruct-q4_K_M
Q4 6 GBQ8 8 GB
$ phi4-mini:3.8b
Q4 36 GB
$ laguna-xs.2:q4_K_M
Q4 2 GB
$ qwen2.5:0.5b-instruct-q4_K_M
Q4 4 GB
$ qwen2.5:1.5b-instruct-q4_K_M
Q4 16 GB
$ qwen2.5:14b-instruct-q4_K_M
Q4 4 GB
$ qwen2.5:3b-instruct-q4_K_M
Q4 16 GB
$ qwen2.5-coder:14b
Q4 8 GB
$ qwen2.5-coder:7b
Q4 72 GBQ8 128 GB
$ qwen3-next:80b
Q4 2 GB
$ qwen3.5:0.8b
Q4 4 GB
$ qwen3.5:2b
Q4 6 GBQ8 8 GB
$ qwen3.5:4b
Qwen3.8 2.4T A95Bdatacenter-class
Datacenter
Q4 192 GB
Q4 1 GB
$ smollm2:360m
Xiaomi MiMo-V2-Flashdatacenter-class
Datacenter

Scores are for full-precision or API runs; the Q4 build you run locally may score lower. The Epoch Capabilities Index (Epoch AI) and the LMArena text leaderboard (overall) (LMArena) are separate sources and are never mixed or averaged.

Which local model is best for coding?

SWE-Bench Verified

The best open-weight LLM on SWE-Bench Verified is Qwen3.8-27B (86.0%), which runs on a 24GB Mac, 11.0 points behind Claude Opus 5 (97.0%). SWE-Bench Verified is the headline real-world software-engineering benchmark; scores are third-party, raw-confirmed against each model's primary source.

Claude Opus 5
97.0% Cloud
DeepSeek V4 Pro 0813
96.4% Local ✅
GPT-5.6-sol
96.2% Cloud
Grok 4.6
95.6% Cloud
GPT-5.6-terra
95.4% Cloud
GLM-5.3
95.4% Local ✅
Kimi K3
93.4% Local ✅
GLM-5.3 Flash
92.0% Local ✅
Local / open-weight Cloud / closed

SWE-Bench Verified leaderboard

Sources confirmed 2026-10-03
#ModelSWE-Bench VerifiedTypeRuns onGet itSourceVerified
1
Claude Opus 5Cloud API
97.0%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
2
DeepSeek V4 Pro 08131.6T / 49B MoE
96.4%LocalMulti-node rign/avals.ai SWE-Bench Verified leaderboard2026-10-03
3
GPT-5.6-solCloud API
96.2%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
4
Grok 4.6Cloud API
95.6%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-10-03
5
GPT-5.6-terraCloud API
95.4%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-10-03
6
GLM-5.3753B MoE
95.4%LocalMulti-node or 512GB-class rign/avals.ai SWE-Bench Verified leaderboard2026-10-03
7
Claude Fable 5Cloud API
95.0%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
8
Kimi K32.8T / 104B MoE
93.4%LocalMulti-node rign/avals.ai SWE-Bench Verified leaderboard2026-09-29
9
GPT-5.6-lunaCloud API
93.0%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
10
GLM-5.3 Flash321B / 18B MoE
92.0%Local192GB-class machine (llama.cpp)n/avals.ai SWE-Bench Verified leaderboard2026-10-03
1188.8%Local192GB-class machine (llama.cpp)n/avals.ai SWE-Bench Verified leaderboard2026-10-03
12
Claude Opus 4.8Cloud API
88.6%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
13
Grok 4.5Cloud API
86.6%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
1486.0%Local24GB Mac
$ qwen3.8:27bregistry-verified
vals.ai SWE-Bench Verified leaderboard2026-10-03
15
Qwen3.8-MaxCloud API
85.6%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-10-03
16
GLM-5.2753B MoE
82.8%LocalMulti-node or 512GB-class rign/avals.ai SWE-Bench Verified leaderboard2026-09-29
17
GPT-5.5Cloud API
82.6%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
18
Inkling Small276B / 12B MoE
82.2%Local192GB Mac (MLX)n/avals.ai SWE-Bench Verified leaderboard2026-10-03
19
Claude Opus 4.7Cloud API
82.0%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
20
Gemini 3.8 FlashCloud API
80.0%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-10-03
21
Claude Sonnet 5Cloud API
79.6%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-10-03
22
Gemini 3.1 ProCloud API
78.8%CloudCloud APIAPI onlyvals.ai SWE-Bench Verified leaderboard2026-09-29
23
Kimi K2.7-Code1T / 32B MoE
78.2%LocalMulti-node or 512GB-class rign/avals.ai SWE-Bench Verified leaderboard2026-09-29
24
DeepSeek V4 Pro1.6T / 49B MoE
77.4%LocalMulti-node rign/avals.ai SWE-Bench Verified leaderboard2026-09-29
2577.2%Local32GB Mac
$ qwen3.6:27bregistry-verified
Qwen3.6-27B HuggingFace model card2026-09-29
26
MiniMax M3428B / 23B MoE
75.0%Local256GB-class workstationn/avals.ai SWE-Bench Verified leaderboard2026-09-29
2775.0%Local24GB Mac
$ qwen3.5:27bregistry-verified
Qwen3.5-27B HuggingFace model card2026-09-29
28
Qwen3.6-35B-A3B35B / 3B MoE
73.4%Local32GB Mac
$ qwen3.6:35b-a3bregistry-verified
Qwen3.6-35B-A3B HuggingFace model card2026-09-29
29
NVIDIA Nemotron 3 Ultra550B / 55B MoE
69.0%Local256GB-class multi-node rign/avals.ai SWE-Bench Verified leaderboard2026-09-29
3066.4%Local96GB+ Macn/avals.ai SWE-Bench Verified leaderboard2026-09-29
31
Devstral 2 (2512)Open-weight 24B
62.8%Local32GB Macn/avals.ai SWE-Bench Verified leaderboard2026-09-29

Third-party SWE-Bench Verified scores. Each % is re-confirmed against the linked primary source and each Ollama tag re-probed against the registry (HTTP 200) on each refresh. Closed-API parameter counts are undisclosed ("Cloud API").

Looking for speed instead of capability? See measured tokens/sec from readers' machines.

Real-world calibration

Have this hardware? Share a measured run.

Measure a fixed Ollama reference model on your machine. This separate, opt-in contribution does not change ModelFit's third-party SWE-Bench leaderboard; results appear on the measured-speed leaderboard after the next site update.

$ npx -y @wecko-ai/modelfit bench --submit --cleanup
CLI setup and package details →See measured machines →
Methodology

How this leaderboard stays honest

  • Capability: Epoch Capabilities Index by Epoch AI (raw data, data of 2026-10-13). It combines many benchmarks into one scale, so a 2023 cloud model and a 2026 open-weight model can be compared directly.
  • Human preference: LMArena text leaderboard (overall) by LMArena (raw data, snapshot of 2026-10-08). Shown in its own column for context only.
  • Coding: third-party SWE-Bench Verified results, each re-confirmed against its primary source.
  • The tier rule: "Above GPT-4o" means the model's whole ECI range sits above GPT-4o's range. "GPT-4o class" means its score is at or above GPT-4o's but the two ranges overlap. Every such claim uses ECI only, never LMArena, and the two sources are never mixed or averaged.
  • Precision: scores are for full-precision or API runs. The Q4 build you run locally may score lower, and ModelFit does not invent a number for that gap.
  • Unscored models stay unscored: a model is matched to a source only when the source scored the same weights. No estimate fills a gap, and ModelFit's own engine ratings are never shown as benchmark scores.
  • Fit: "runs on" and minimum memory come from the ModelFit engine, the same one behind every recommendation on the site. ModelFit runs no benchmarks.
  • License: ECI and LMArena data are CC BY 4.0, credited to Epoch AI and LMArena; selected and mapped to ModelFit's catalog by ModelFit.

Frequently asked questions

Can a local LLM match GPT-4?
Yes. 39 of the 44 scored open-weight models reach GPT-4 (Mar 2023) class or above on the Epoch Capabilities Index. The smallest is Qwen3.5 9B, which needs 12 GB of memory and scores 139.5 against 125.9 for GPT-4 (Mar 2023).
What is the best model a 16 GB Mac can run?
A 16 GB MacBook Air (M5) runs Qwen3.5 9B, which scores 139.5 on the Epoch Capabilities Index: GPT-4.5 (Feb 2025) class, and above GPT-4 (Mar 2023) and GPT-4o (May 2024). It is the highest-scoring model the ModelFit engine fits in 16 GB. Pull it with: ollama run qwen3.5:9b.
Are these scores measured by ModelFit?
No. Capability scores come from Epoch AI's Epoch Capabilities Index (data of 2026-10-13) and the LMArena text leaderboard (snapshot of 2026-10-08), both CC BY 4.0. Coding scores are third-party SWE-Bench Verified results. ModelFit maps them to its catalog and runs no benchmarks. Scores are for full-precision or API runs; the Q4 build you run locally may score lower.
Why do ECI and LMArena rank models differently?
The Epoch Capabilities Index combines many benchmarks into one capability scale, while LMArena rates models by human votes in blind side-by-side chats. They measure different things: o1 (Dec 2024) is ahead on ECI (141.9 vs 136.7), but GPT-4.5 (Feb 2025) is ahead on LMArena (1417 vs 1366). This page keeps them in separate columns and every "class" or "above" claim uses ECI only.

Want the full analysis?

Detailed comparisons, RAM costs on Apple Silicon, and what runs on your Mac.

Read Full Article