Inkling Small
Inkling Small publishes its weights, but at 276B parameters (12B active per token) no consumer machine holds the checkpoint. This page covers the access paths that work and the open models that actually run locally.
- Parameters
- 276B(12B active)
- Format
- API
- Runs locally
- No
- Best for
- Agentic coding, Multimodal, Reasoning
Why you can't run Inkling Small locally
At 276B parameters (12B active per token), a Q4-class build of Inkling Small would need roughly 166 GB, a 256GB Mac Studio could hold the weights in principle, but no registry-verified local build exists today. That figure is arithmetic, not opinion: 0.6 GB per billion parameters is the standard Q4 rule we apply across the whole catalog. The weights themselves are public (official source linked below); capacity, not licensing, is the wall.
What works instead: the hosted API. For most workloads, the open models below deliver the same job on hardware that fits under a desk.
Thinking Machines Lab open-weight MoE (Jul 2026, Apache 2.0): 276B total, 12B active, routed to 6 of 256 experts plus 2 shared. Text, image and audio input. SWE-bench Verified 80.2% per its model card. No Ollama tag and mainline llama.cpp does not load it yet; on a Mac the working path is MLX (the mlx-community 4-bit build is about 153 GB, a 192GB-class machine). Unsloth GGUFs are published for when llama.cpp support lands.
What to run locally instead of Inkling Small
| Model | Params | Runs on | Use |
|---|---|---|---|
| Qwen3.5 122B-A10B Instruct | 122B | from 96 GB machines | frontier-level reasoning |
| Qwen3.8 27B | 27B | from 24 GB machines | coding |
| Laguna S 2.1 | 118B | from 128 GB machines | agentic coding |
Get told when a better model fits your MacBook Air M5 16 GB
Get one email when a new open-weight model is a better fit for this machine.
For: MacBook Air M5 16 GB
You'll also get the weekly ModelFit email. By signing up you agree to our Privacy Policy. Unsubscribe from either email anytime, in one click.
Config reports
No speed test run for this model yet. Run the speed test: npx @modelfit/cli@latest bench
Share your config
Frequently asked questions
Can I run Inkling Small locally?
Not on hardware you can buy. The weights are public, but Inkling Small is a 276B-parameter model (12B active), and a Q4-class build would need roughly 166 GB, a 256GB Mac Studio could hold the weights in principle, but no registry-verified local build exists today. Until the ecosystem ships a smaller official build, the API or a smaller open model is the practical path.
How do I access Inkling Small?
Through the vendor's hosted API. The official source is linked on this page.
What is the best local alternative to Inkling Small?
Qwen3.5 122B-A10B Instruct is the strongest local model we track (122B, from 96 GB machines), with Qwen3.8 27B close behind. Both run on a single high-memory Mac or GPU, see their pages for exact hardware.
Cite this page
ModelFit: Inkling Small, specs, memory math and hardware verdicts. https://modelfit.io/models/inkling-small/ (dataset updated 2026-11-16, CC BY 4.0).