32.7 tok/s on Qwen3.5 9B Instruct

Apple M2 Pro 16-core GPU · 16GB, measured with Ollama on 2026-11-02.

Generation
32.7 tok/s
Prompt reading
259 tok/s
Rank
#7 of 9
ModelFit estimate
est. 32 tok/s
Speed test card: Apple M2 Pro 16-core GPU · 16GB, 32.7 tok/s on Qwen3.5 9B Instruct · nvfp4 MLX · 7.7 GB
Share your result

The card shows your rank on the day of the run; the rank on this page stays live.

See this machine on the leaderboard

Follow @modelfit_ on X

How this run was measured

Machine
Apple M2 Pro 16-core GPU · 16GB
Model
Qwen3.5 9B Instruct · nvfp4 MLX · 7.7 GBqwen3.5:9b · MLX runner · classic decoding
Method
median of 3 runs · Ollama 0.40.13 · 4k context · 2026-11-02256 generated tokens per run, prompts of about 500 tokens

Measure your machine

$ npx @modelfit/cli@latest bench

Needs Node and Ollama. It picks a model that fits your machine and asks before it sends anything.

Qwen3.5 9B Instruct at 32.7 tok/s on Apple M2 Pro 16-core GPU · 16GB | ModelFit speed test