104 tok/s on Qwen3.5 4B Instruct
NVIDIA GeForce RTX 5060 Ti, measured with Ollama on 2026-11-11.
- Generation
- 104 tok/s
- Prompt reading
- 4144 tok/s
- Rank
- #2 of 9
- ModelFit estimate
- est. 123 tok/s
How this run was measured
- Machine
- NVIDIA GeForce RTX 5060 Ti
- Model
- Qwen3.5 4B Instruct · Q4_K_M · 3.1 GBqwen3.5:4b · classic decoding
- Method
- median of 3 runs · Ollama 0.40.16 · 4k context · 2026-11-11256 generated tokens per run, prompts of about 500 tokens
Measure your machine
$ npx @modelfit/cli@latest bench
Needs Node and Ollama. It picks a model that fits your machine and asks before it sends anything.
Get an email when a better model fits RTX 5060 Ti
Get one email when a new open-weight model is a better fit for this machine.
For: RTX 5060 Ti
You'll also get the weekly ModelFit email. By signing up you agree to our Privacy Policy. Unsubscribe from either email anytime, in one click.