Best Local AI Models for Mac Mini

Mac Mini configurator

Apple list prices checked 2026-10-19 · US store · speeds are engine estimates

01

Chip.

Bandwidth sets generation speed.

Generation speed follows memory bandwidth in this estimate; GPU cores speed up prompt reading.

02

Memory.

Sets which models fit.
03

Use.

What will you run?
Use case
Min speed
Must run
Fig. 1cSpeed feel · any model on this configuration

See how fast it feels

Qwen3.5 9B Instruct, already loaded in memory: ~1.2s to read the prompt (instant), then it writes at est. 28 tok/s, typical error 5%.

zsh · ollama run qwen3.5:9best. 28 tok/s

~ $ ollama run qwen3.5:9b

# Press Send to run the fixed message below.

# fixed message, the same for every model

>>> Summarize these meeting notes in one short paragraph: what was decided, and who does what next.

[meeting-notes.txt]
Weekly sync, support tools team
Attendees: Maya (lead), Jonas, Priya, Tom, Elena
Agenda: local drafting assistant pilot, knowledge base cleanup, customer feedback survey, on-call rota, next steps

1. Local drafting assistant pilot
- Maya recapped the goal: agents draft replies with an assistant that runs on the team's own Macs, so customer emails never leave the building and nothing depends on an outside service being up.
- Jonas ran the pilot for two weeks on four machines. Agents used it for first drafts on roughly a third of tickets. Most drafts needed light edits. A few needed a full rewrite, mostly billing questions where the model guessed at policy instead of saying it did not know.
- Priya said the biggest complaint was the wait before the first word on long tickets. Short tickets felt instant. Tickets with a long email thread pasted in took several seconds before anything appeared, and agents read that as the tool being stuck. Two agents restarted the app because of it.
- Tom suggested trimming the thread to the last three messages before sending it to the model. Elena worried that would drop context the customer refers back to, like an order number from the first email. Agreed to test both on the same set of tickets before choosing.
- Jonas said the speed once the reply starts was fine on every machine. Agents read slower than the model writes, so nobody asked for faster output. The only request was a visible sign that the model is reading, so people stop restarting it.
- Memory: the oldest machine, the one with the least memory, could not keep the model loaded next to the browser and the ticketing app. It swapped and slowed down badly by mid-morning. The other three machines had no issue all day.
- Priya asked whether a larger model would fix the billing guesses. Jonas thought not: the model guesses because the policy text it needs is missing or contradictory, and a bigger model would guess more fluently, not less.
- Decision: keep the current model size for now. Revisit only after the knowledge base cleanup, and only if the edit rate on billing drafts is still high.

2. Knowledge base cleanup
- Elena found about forty articles that contradict each other on refund windows and plan changes. These are the likely source of the billing guesses.
- Priya proposed one owner per section, with a review date on every article so stale pages show up on their own instead of during an angry ticket.
- Agreed: Elena owns billing and refunds, Priya owns accounts and login, Tom owns shipping and returns. Each owner archives duplicates, merges the rest, and flags anything that needs a policy decision from Maya.
- Jonas will add the cleaned articles to the assistant's reference folder once each section is signed off, not before. Mixing old and new versions would make the guessing worse.
- Tom asked for a template for new articles. Elena will share the one billing already uses.

3. Customer feedback survey
- Priya shared the quarterly survey results. Response time scores went up since the last quarter, and the free-text comments mention faster first replies more than once.
- Several comments still complain about being asked for the same order details twice. Elena thinks this happens when a ticket moves between agents and the notes field is left empty.
- Agreed: the handover checklist gets one new line, fill in the notes field before reassigning a ticket. Tom will update the checklist and post it in the team channel.
- Maya wants the next survey to ask one question about reply quality, not only speed, so the team can see whether the assistant drafts change how customers rate answers.

4. On-call rota
- Two people asked to swap weeks in November. Maya approved both swaps.
- Tom raised that weekend coverage gets thin when two people are on leave at the same time. Agreed that leave requests go in the team channel at least two weeks ahead, and Maya checks the rota before approving.
- No change to escalation rules. The escalation doc is still correct.

5. Next steps
- Jonas: run the trimmed thread versus full thread test on fifty past tickets and report the wait before the first word and the edit rate for each.
- Jonas: add a reading indicator to the assistant panel so agents can see the model is working on a long ticket.
- Elena, Priya, Tom: finish their knowledge base sections and send Maya the open policy questions.
- Maya: ask IT whether the oldest machine can get more memory or should be replaced at the next refresh.
- Everyone: log any draft that invents a policy, with the ticket link, in the shared sheet.
- Next sync: same time next week. Maya sends the agenda the day before.

ModelFit engine estimate, not a measured benchmark. Loading the model is not included. Real speed varies with thermals, runtime, and KV-cache settings.

Table 1Ranking for this configuration · follows the Use step

Best local models for Mac Mini M6 · 16 GB

20 of the top 20 · all uses · any speed · tok/s are engine estimates, not measurements

ModelQuantFitRun
19BQ4_K_M7.0 GBRuns well24.728
28BQ4_K_M6.5 GBRuns welln/a26
312BQ4_K_M8.0 GBRuns well21.918
49BQ4_K_M5.6 GBRuns welln/a28
58.4BQ4_K_M6.0 GBRuns well7.723
68.7BQ4_K_M5.7 GBRuns welln/a27
78BQ4_K_M6.5 GBRuns well-2.627
812BQ4_K_M9.5 GBRuns well5.518
99BQ4_K_M5.8 GBRuns welln/a27no Ollama tag
1013.5BQ4_K_M9.1 GBRuns well10.115
1112BQ4_K_M9.5 GBRuns well-4.819
124.5BQ8_07.5 GBRuns well13.828
138BQ8_08.1 GBRuns welln/a16
144BQ4_K_M3.5 GBPerfect fit19.549
159BQ4_K_M7.0 GBRuns well-4.920
164.5BQ4_K_M4.0 GBPerfect fit13.840
178.3B moe 1.5BQ4_K_M5.5 GBRuns welln/a80
188BQ5_K_M8.0 GBRuns well-2.624
198BQ8_08.0 GBRuns well-2.617
2014BQ4_K_M11.0 GBRuns well18.115

Click a row to map its memory in Fig. 1Quality: LLM Stats Score · Data by LLM StatsOllama commands are registry-verified

Fig. 2A / B · what the other configuration changes

What B unlocks

Compare with any Mac or GPU
SpecA · yoursBChange
ConfigurationM6 12C · 16 GBM6 12C · 24 GB
Apple list price$899$1,099+$200
Memory bandwidth153 GB/s170 GB/s+17 GB/s
Usable for models11.2 GB16.8 GB+5.6 GB
Models that run5670+14
Largest that runs14B29.3B+15.3B
Top pickQwen3.5 9B Instruct
est. 28 tok/s
GPT-OSS 20B
est. 38 tok/s
B runs 14 models that A cannot
Granite 4.2 30B29.3Best. 9 tok/s
Qwen3.8 27B27Best. 10 tok/s
Qwen3.5 27B Instruct27Best. 10 tok/s
Gemma 4 26B-A4B26Best. 38 tok/s
LFM2 24B-A2B Instruct24Best. 66 tok/s
Devstral Small 2 24B24Best. 10 tok/s
Mistral Small 3.124Best. 10 tok/s
GPT-OSS 20B21Best. 38 tok/s
Phi-4 14B14Best. 17 tok/s
Qwen3 14B (Q8)14Best. 10 tok/s
and 4 more

The Mac Mini is the cheapest way into local AI on Apple Silicon. The 2026 M6 with 16GB runs Qwen3.5 4B and 9B-class models comfortably, 24-32GB M6 configs step up to 14B-class models, and M5 Pro configs with 48-64GB handle 27B models, with active cooling that sustains speeds the fanless MacBook Air cannot.

Quick answer

On a Mac Mini, the best local LLM ranges from Qwen3.5 4B Instruct at 8GB to Qwen3.6 35B-A3B (Q8) at 64GB. That spans 8GB to 64GB configurations, where 100 of ModelFit's 116 local models fit comfortably at the top tier. Set your exact chip and memory in the configurator above for its ranked list.

Sizing rule: a local model needs about 0.6 GB of unified memory per billion parameters at Q4, and ModelFit budgets roughly 70% of each configuration's RAM. At 8GB the best fit is Qwen3.5 4B Instruct (~3.5GB); at 64GB it is Qwen3.6 35B-A3B (Q8) (~38.7GB), reaching est. 60 tok/s, typical error 10%. Mid-range configurations trade model size for speed between those two points. What it will not run: even the 64GB tier leaves Llama 3.3 70B Instruct (Q8) (70B) to a cloud API, and the 8GB tier caps out far earlier.

→ Set your exact chip and memory in the configurator above for its ranked models and one-line install command.

Entry (M1, 8GB)
Qwen3.5 4B Instruct
Top (M5 Pro, 64GB)
Qwen3.6 35B-A3B (Q8)
Decode speed range
est. 18-60 tok/s, typical error 10%

Speeds are ModelFit estimates from chip bandwidth and model size, not measured benchmarks. Typical error: the median gap between the ModelFit speed model and measured runs on hardware the model was not fitted on, for this backend and model size.

Cite this page: ModelFit, Best Local AI Models for Mac Mini, https://modelfit.io/mac-mini/, updated October 2026, CC BY 4.0.

Context costs memory too. Qwen3.5 9B Instruct loads ~7 GB of weights; at 16k context the KV cache adds ~0.5 GB (still fits the ~11 GB usable RAM), and at 64k it adds ~2.0 GB (still fits).

Weights 7.0 GBKV cache · 16k context 0.5 GBHeadroom 3.7 GBOS / runtime reserve 4.8 GB

The model leaves about 3.7 GB of the usable unified memory budget free after weights and 16k context.

KV-cache figures assume an fp16 cache, the llama.cpp/Ollama default. Standard GQA models use a size-class estimate (8 KV heads x 128 head dim class); hybrid linear-attention models (Qwen3.5/3.6, Qwen3-Next) use the exact per-token cost from their published config, since only their sparse full-attention layers cache KV. A q8_0 KV cache roughly halves either figure. Estimates, not measurements.

By chip generation

Pick your exact Mac Mini chip

Where to buy for local AI

best configs

ModelFit may earn a commission on purchases through these links, at no extra cost to you.

Related devices
Related guides

Related setup guides

From the blog

Mac Mini local AI articles

Popular model families

FAQ

Frequently asked questions

What is the best AI model for Mac Mini?

The Mac Mini is the cheapest way into local AI on Apple Silicon. The 2026 M6 with 16GB runs Qwen3.5 4B and 9B-class models comfortably, 24-32GB M6 configs step up to 14B-class models, and M5 Pro configs with 48-64GB handle 27B models, with active cooling that sustains speeds the fanless MacBook Air cannot. On the default Apple M6 with 16GB RAM, Qwen3.5 9B Instruct is our top pick, handling models up to about 12B parameters at this RAM. Higher-RAM Mac Mini configurations, including Pro and Max tiers where available, reach into the 9B-27B parameter range.

What size models fit on Mac Mini?

With 16GB unified memory, Mac Mini runs models up to about 12B parameters comfortably. Strong picks include Qwen3.5 9B Instruct, Qwen3 8B, Gemma 4 12B. Higher-RAM configurations, including Pro and Max tiers where available, reach into the 9B-27B parameter range. Use the ModelFit wizard to match your exact RAM and chip.

How fast is local AI on Mac Mini?

On the Apple M6 with optimized, quantized models, expect est. 28 tok/s, typical error 5%. The Mac Mini M6 (2026) pairs 153 GB/s memory bandwidth (170 GB/s on 24GB and 32GB configs) with desktop cooling, so 9B-14B class models sustain full speed on long runs. In ModelFit estimates the 16GB config matches M5-class speed on a 7B Q4 reference (~31 tok/s); the M5 Pro option at 307 GB/s with up to 64GB lifts the ceiling to 27B-class models. Announced 2026-08-26, shipping September 22. (Speeds are ModelFit estimates, not measured benchmarks, and vary with model size and quantization.)

Real-world calibration

Have this hardware? Share a measured run.

Measure a fixed Ollama reference model on your machine. This separate, opt-in contribution does not change ModelFit's third-party SWE-Bench leaderboard; results appear on the measured-speed leaderboard after the next site update.

$ npx -y @wecko-ai/modelfit bench --submit --cleanup