150 tok/s on Qwen3.8 27B
NVIDIA GeForce RTX 5090, measured with Ollama on 2026-11-10.
- Generation
- 150 tok/s
- Prompt reading
- 1924 tok/s
- Rank
- #1 of 12
- ModelFit estimate
- est. 89 tok/s
How this run was measured
- Machine
- NVIDIA GeForce RTX 5090
- Model
- Qwen3.8 27B · Q4_K_M · 17.3 GB · spec. decoding · 4k ctxqwen3.8:27b · speculative decoding: several tokens per pass over the weights, ranked apart from classic runs
- Method
- median of 3 runs · Ollama 0.40.16 · 4k context · 2026-11-10256 generated tokens per run, prompts of about 500 tokens
- Posted by
- @alienatedsec
Measure your machine
$ npx @modelfit/cli@latest bench
Needs Node and Ollama. It picks a model that fits your machine and asks before it sends anything.
Get an email when a better model fits RTX 5090
Get one email when a new open-weight model is a better fit for this machine.
For: RTX 5090
You'll also get the weekly ModelFit email. By signing up you agree to our Privacy Policy. Unsubscribe from either email anytime, in one click.