101 tok/s on Qwen3.5 4B Instruct
NVIDIA GeForce RTX 3070, measured with Ollama on 2026-11-14.
- Generation
- 101 tok/s
- Prompt reading
- 3453 tok/s
- Rank
- #4 of 9
- ModelFit estimate
- est. 109 tok/s
How this run was measured
- Machine
- NVIDIA GeForce RTX 3070
- Model
- Qwen3.5 4B Instruct · Q4_K_M · 3.1 GBqwen3.5:4b · classic decoding
- Method
- median of 3 runs · Ollama 0.40.16 · 4k context · 2026-11-14256 generated tokens per run, prompts of about 500 tokens
Measure your machine
$ npx @modelfit/cli@latest bench
Needs Node and Ollama. It picks a model that fits your machine and asks before it sends anything.
Get an email when a better model fits RTX 3070
Get one email when a new open-weight model is a better fit for this machine.
For: RTX 3070
You'll also get the weekly ModelFit email. By signing up you agree to our Privacy Policy. Unsubscribe from either email anytime, in one click.