Blog
Field notes: guides, comparisons, and insights on running local LLMs on Apple Silicon.
This blog covers running local LLMs on Apple Silicon (MacBook Air, MacBook Pro, Mac Studio, Mac mini) and iPhone, plus NVIDIA and AMD GPU hardware picks for local AI. Expect device by RAM tier comparisons, Ollama setup guides, and coverage of new model releases as they land.
Every post links back to the underlying data: hardware fit tables, GPU tok/s estimates, and the model catalog behind ModelFit's recommendation engine. Start with a hub below, or browse the latest articles.
The weekly local-AI refresh
New open-weight models, real Apple Silicon benchmarks, and the one model worth running on your Mac this week. Free, one email a week, unsubscribe anytime.
By subscribing you agree to our Privacy Policy and to receive the weekly email. Unsubscribe anytime.
How Far Behind Cloud AI Is Your Laptop? (2026)
Somewhere between 4 and 25 months, and the honest answer for laptop hardware is close to 11. A chart claiming laptop-runnable AI trails the cloud frontier by an average of 24.8 months went viral on r/...
Run a 744B Model on 25GB RAM? The Honest Math (2026)
Yes, a 744B-parameter model can run on a machine with 25GB of RAM. A new open-source engine called colibri does it by streaming GLM-5.2's experts from an NVMe drive, and it earned over 1,200 GitHub st...
Mac Mini for Local AI: Buy M4 Now or Wait for M5? (2026)
> TL;DR: Buy the Mac Mini M4 now if you need a local AI machine this year. The entry price already jumped from $599 to $799 (Bloomberg, 2026), memory prices are still climbing, and the M5 mini is only...
Apple M7 for Local AI: Roadmap and What to Run Now (2026)
> TL;DR: Apple is reportedly fast-tracking the M7 chip, moving its release up by about half a year, with a rumored base memory bandwidth near 240 GB/s, a 57% jump over the M5's confirmed 153 GB/s. Non...
Which Bottleneck Are You Buying? Local AI Hardware Guide (2026)
> TL;DR: Local AI hardware comes down to three things: memory capacity (what fits), memory bandwidth (how fast it answers), and software stack maturity (how much of the spec you actually get). Vendor ...
Gemma 4 12B: Best Local LLM for 16GB RAM (2026)
> TL;DR: Gemma 4 12B is Google's dense, Apache 2.0 model that fits a 16GB Mac or 8-12GB GPU at its default 7.6GB quant (ollama run gemma4:12b). It scores 77.2% on MMLU Pro and beats last year's Gemma ...
Local LLM Refresh: A Coding Wave Hits Ollama (June 2026)
> TL;DR: Three 30B-class Mixture-of-Experts models with about 3B active parameters landed on Ollama this fortnight: Cohere's North Mini Code and Poolside's Laguna XS.2 (both coding-focused, Apache 2.0...
PewDiePie's Odysseus: Why It Matters for Local AI (2026)
> TL;DR: PewDiePie released Odysseus, a free, self-hosted AI workspace under AGPL-3.0 that passed 74,000 GitHub stars in about three weeks. It runs on any hardware, not just his own 424GB, 10-GPU rig....
Best LLM for MacBook Air M2 16GB: 5 Models Ranked (2026)
> TL;DR: The MacBook Air M2 with 16GB RAM comfortably runs models up to ~14B parameters at Q4. Qwen3.5 9B is the best all-rounder: ~7GB loaded, native multimodal, near-frontier quality. Qwen3.5 4B is ...
AMD Strix Halo: 128GB Local AI Under $2,000 (2026)
> TL;DR: The AMD Ryzen AI Max+ 395 ("Strix Halo") puts 128GB of unified memory in a mini PC, letting it load models up to ~200 billion parameters locally, something no consumer GPU can do. On Linux it...
Local LLM Weekly: Gemma 4 12B Hits Ollama (June 2026)
> TL;DR: Gemma 4 12B is the week's standout local release: a 16GB-friendly multimodal model (ollama run gemma4:12b) scoring 77.2 on MMLU-Pro. Six cloud-only flagships also shipped, including Anthropic...
Best LLM for MacBook Air M5 16GB: 5 Models Ranked (2026)
> TL;DR: The MacBook Air M5 with 16GB RAM runs the same ~14B-parameter ceiling as the M4 Air, but its 153 GB/s memory bandwidth (a 28% jump over the M4's 120 GB/s, per Apple) makes every model faster....
MLX vs Ollama on Mac (2026): Which Runtime Is Fastest?
> TL;DR: On Apple Silicon, MLX-based runtimes now beat the old llama.cpp path by roughly 1.4x on dense models and up to 3x on mixture-of-experts models. Ollama 0.19 (March 2026) switched to MLX itself...
Does Speculative Decoding Speed Up Local LLMs on Mac? (2026)
> TL;DR: Speculative decoding lets a model draft several tokens and verify them in one pass, 2x or more faster, with identical output. But on a Mac the framework decides everything. With llama.cpp on ...
How We Scored 100/100 on Agent-Readiness (2026)
> TL;DR: ModelFit scored a perfect 100/100, Level 5 "Agent-Native" on isitagentready.com, up from 27 before we started. We passed 14/14 checks across four scored categories by shipping the emerging ag...
Run a Local LLM on Mac With No Terminal (2026)
> TL;DR: LM Studio is a free desktop app that runs local LLMs with a ChatGPT-style chat window, a one-click model browser, and built-in Metal acceleration, no terminal required. Install it, pick a mod...
Qwen 3.6 on Mac: The 17GB Coder Scoring 77.2 (2026)
> TL;DR: Qwen 3.6 27B scores 77.2 on SWE-Bench Verified (Qwen3.6-27B card, 2026) and downloads at ~17GB on Ollama, so it fits a 32GB Mac. The MoE sibling, 35B-A3B, activates only 3B params per token, ...
Should You Run IBM Granite 4.1 (3B / 8B) Locally on Your Mac?
IBM shipped Granite 4.1 in early June 2026, a full refresh of its open-weight lineup. The family includes dense decoder-only models at 3B, 8B, and 30B, all Apache 2.0 licensed and trained on roughly 1...
LFM2.5 on Mac: Run Liquid AI's Fastest Local Model with Ollama (2026)
Liquid AI shipped LFM2.5 in early 2026, and the 8B-A1B variant is the sweet spot for Apple Silicon. It packs 8.3 billion total parameters but activates only 1.5 billion per token. That means MacBook A...
Best LLMs for Mac Mini M4 16GB RAM: Top 5 Ranked (2026)
> TL;DR: The Mac Mini M4 with 16GB RAM runs models up to ~13B parameters at Q4 quantization without breaking a sweat. Qwen3.5 9B is the best daily driver: near-frontier quality in ~7GB, with native mu...
Best LLMs for Mac Mini M4 24GB RAM: Top 6 Ranked (2026)
> TL;DR: The Mac Mini M4 with 24GB RAM runs models up to ~20B parameters at Q4 quantization cleanly, and squeezes 27B at a tight fit. Qwen3.5 9B is the best daily driver, near-frontier quality in ~7GB...
Best LLM for MacBook Air M4 16GB: 5 Models Ranked (2026)
> TL;DR: The MacBook Air M4 with 16GB RAM can comfortably run models up to ~14B parameters at Q4 quantization. Qwen3.5 9B is the best all-rounder: it fits in ~7GB, ships native multimodal support, and...
Best LLM for MacBook Air M4 24GB: 6 Models Ranked (2026)
> TL;DR: The MacBook Air M4 with 24GB RAM runs models up to ~20B parameters at Q4 quantization, and pushes to qwen3.5:27b at a tight fit. Qwen3.5 9B is the best daily driver: near-frontier quality, na...
Best LLM for MacBook Pro M4 Max 64GB (2026)
> TL;DR: The MacBook Pro M4 Max with 64GB RAM is a 70B-capable laptop. Qwen3.6 27B is the quality pick at ~20-30 tok/s (est.), fitting in ~18GB. Qwen3.6 35B-A3B delivers near-flagship reasoning at sma...
Best LLM for MacBook Pro M4 Pro with 24GB RAM (2026)
> TL;DR: The MacBook Pro M4 Pro with 24GB RAM is one of the best local AI machines you can buy. Qwen3.5 9B is the clear all-rounder, near-frontier quality, native multimodal, ~7GB loaded at interactiv...
Best LLM for MacBook Pro M5 Pro 64GB (2026)
> TL;DR: The MacBook Pro M5 Pro with 64GB is the sweet spot for serious local AI. Qwen3.6 27B at Q4 needs only ~18GB and runs at usable speeds, while 7B-class daily drivers hit 80-100 t/s (Apple). The...
Qwen on Mac (2026): Best 3.6 & 3.5 Models by RAM Tier
> TL;DR: On a Mac, Qwen 3.6 27B is the current top coder if you have 24GB or more RAM (it scores 77.2 on SWE-Bench Verified, ~16GB at Q4). Qwen 3.5 35B-A3B is the efficiency pick: 35B total but only 3...
Best Local AI Coder for Mac: Qwen3.6 vs Gemma 4 (2026)
> TL;DR: Qwen3.6-35B-A3B is the best local coder for Mac: 73.4 on SWE-bench Verified with only 3B active parameters, fitting a 24GB Apple Silicon machine. Gemma 4 31B matches it on knowledge (85.2 MML...
Your Local LLMs Just Got 2x Faster on Mac (May 2026)
> TL;DR: May 2026 shipped no new must-run open-weight model. The gains came from the runtime layer. Ollama added Gemma 4 MTP speculative decoding ("over a 2x speed increase" on coding) and reworked it...
The April 2026 Local LLM Wave: Qwen3.6, Gemma 4, Llama 4, DeepSeek V4
> TL;DR: Four frontier open-weight families shipped in April 2026: Qwen3.6, Gemma 4, Llama 4 Scout/Maverick, and DeepSeek V4. Qwen3.6-27B leads dense open models on SWE-Bench Verified at 77.2%, closin...
Run a 35B LLM on a $599 Mac Mini M4 (16GB): The mmap Trick
> TL;DR: A base Mac Mini M4 with 16 GB RAM can run Qwen3.5-35B-A3B at 17.3 tok/s with zero swap using llama.cpp's --mmap flag. The model is a Mixture-of-Experts (35B total, only 3B active per tok...
Run Gemma on iPhone: Google AI Edge Gallery Guide (2026)
> TL;DR: Google AI Edge Gallery is a free Apple App Store app that runs Gemma 4 E2B (~2.5 GB) and E4B (~5 GB) fully on-device on iPhone. Real-world speed: ~30 tok/s on iPhone 16 Pro, ~12 tok/s on iPho...
Run Claude Code Free: Ollama Local Setup in 4 Steps (2026)
Claude Code is Anthropic's AI coding agent, and you can run it locally with Ollama instead of paying $100/month for Claude Max. Since Ollama v0.14 shipped native Anthropic Messages API compatibil...
LFM2 + LocalCowork: Offline AI Agent for Mac (2026)
Liquid AI just shipped a working on-device AI agent, not a demo, a real one. LFM2-24B-A2B paired with LocalCowork runs 75 MCP tools entirely on your Mac: security scanning, file operations, audit logs...
DeepSeek V4 Is Coming: What Mac Users Need to Know (2026)
> Update (May 2026): DeepSeek V4 has since shipped. The official DeepSeek-V4-Pro model card now lists 80.6% on SWE-Bench Verified, confirming the pre-release leaks were in the right range. See our loc...
Mac Mini for Local AI: The Best Value Setup in 2026
> TL;DR: The Mac Mini M4 Pro with 64GB ($1,999-$2,499) is the best value local AI machine in 2026. It runs 30B-class models at 12-18 tok/s, costs ~$25/year in electricity, and gives every gigabyte of ...
Apple Core AI Framework: Core ML Replacement Coming at WWDC 2026
Apple is replacing Core ML with a brand-new framework called Core AI, set to debut at WWDC 2026 this June. The rename from "Machine Learning" to "AI" isn't cosmetic; it signals a fundamental shif...
LLMfit: Find the Best LLM for Your Mac in Seconds (2026)
> TL;DR: LLMfit is a Rust CLI that detects your RAM, CPU, and GPU, then scores 200+ models across quality, speed, fit, and context. It picks the best quantization for your memory and estimates tokens/...
M5 Pro and M5 Max for Local LLMs (2026): What Runs, How Fast
> TL;DR: The M5 Pro and M5 Max bring Neural Accelerators to every GPU core, cutting prompt processing time 3.3-4x versus M4. A prompt that took 81 seconds now takes 18. The M5 Max's 128GB unified memo...
Qwen Team Exodus: 3 Key Leaders Leave Alibaba (2026)
> TL;DR: Qwen tech lead Lin Junyang, post-training head Yu Bowen, and staff researcher Binyuan Hui all left Alibaba in Q1 2026, during Qwen's most productive stretch ever: 9 models in 16 days, 1B+ dow...
Ollama 0.17: Up to 40% Faster on Apple Silicon
> TL;DR: Ollama 0.17 brings 10-15% faster prompt processing on Apple Silicon (up to 40% on NVIDIA), an 8-bit KV cache that halves context memory, and automatic context sizing based on your RAM. Update...
Claude Code on Local LLMs: Complete Setup Guide (2026)
> TL;DR: Claude Code can drive a local model through LiteLLM + llama-server. On a ~$1,400 dual RTX 3090 rig, Qwen3-Coder-Next (80B MoE, 3B active) hit 79 tok/s with expert offloading and passed 7/7 co...
DeepSeek V3 vs Qwen 3.5 on Mac: Speed, RAM and Winner (2026)
> TL;DR: DeepSeek-V3 (671B total, 37B active) posts 88.5 on MMLU and 82.6 on HumanEval-Mul, but its size limits it to 96GB+ Mac Studios. Qwen3.5-35B-A3B scores 85.3 MMLU-Pro, fits a 24GB MacBook Pro, ...
Local LLMs vs GPT-4 and Claude: Benchmark Results (2026)
> TL;DR: The best local models now sit within ~5% of cloud flagships on MMLU. DeepSeek-R1 matches Claude 3.5 Sonnet on HumanEval (92%), and Qwen3.5-35B-A3B beats GPT-3.5 Turbo while running free on a ...
How to Install Ollama on Mac (Apple Silicon, 2026): M1-M5
> TL;DR: Run brew install ollama, then ollama run qwen3.5:4b. That's a capable local LLM on any Apple Silicon Mac with 8GB+ RAM in about 5 minutes. 16GB Macs should step up to Qwen3.5 9B; 24GB+ unlock...
MacBook Air vs Pro for Local LLMs (2026): Which Mac to Buy
> TL;DR: For most local AI users, the MacBook Pro M4 24GB (~$1,900) is the best buy: active cooling sustains long sessions and 24GB fits Qwen3.5-35B-A3B at an estimated 38 tok/s. The Air M4 throttles ...