Can you run Qwen3.8 27B (Q8) on RTX 5090?

Qwen3.8 27B (Q8) Q8_0 on the NVIDIA GeForce RTX 5090: verdict, VRAM math and estimated speed.

Yes, it runs
Quick answer

Yes, the NVIDIA GeForce RTX 5090 runs Qwen3.8 27B (Q8). 27.1 GB weights at Q8_0 vs 28.8 GB usable VRAM; ~32 tok/s est. (ModelFit, 2026).

$ollama run qwen3.8:27b-q8_0
VERDICT
Fits
EST. SPEED
~32 tok/s
WEIGHTS
27.1 GB Q8_0

VRAM math and speed are ModelFit engine estimates, not measurements. Commands are registry-verified Ollama tags.

Cite this page: ModelFit, Qwen3.8 27B (Q8) on RTX 5090, https://modelfit.io/can-i-run/qwen3.8-27b-q8-on-rtx-5090/, updated September 2026, CC BY 4.0.

Last updated: September 24, 2026 · Editor: ModelFit Team

VRAM
32 GB (28.8 usable)
Model weights
27.1 GB Q8_0
Est. speed
~32 tok/s
First token
~0.5s
Fit grade
B · 6

What limits this combo

The four constraints the fit engine checks for Qwen3.8 27B (Q8) on the RTX 5090, in order of what usually breaks first.

Weights fitTight27.1 GB of weights against 28.8 GB usable: it loads, but only 1.7 GB of headroom remains for context and the runtime.
Context ceilingTightContext fits up to 16k tokens; the next tier tips the total over 28.8 GB. Long documents and RAG prompts are what hit this wall first.
SpeedOK~32 tok/s (est.) on 1792 GB/s of memory bandwidth, comfortable for interactive chat and agentic loops.
Use-case ceilingOKStrongest fit: Chat (A). Agentic coding clears its ~30 tok/s floor, so tool-calling loops stay usable.

Where the RTX 5090 sits for Qwen3.8 27B (Q8)

The RTX 5090 is the cheapest tracked card that runs Qwen3.8 27B (Q8) fully in VRAM (~32 tok/s est.). Every cheaper card in the table forces partial offload.

CardVRAMUsableVerdictEst. speedMax context
RTX 40608 GB7.2 GBNo~1 tok/snone
RTX 306012 GB10.8 GBNo~1 tok/snone
RTX 407012 GB10.8 GBNo~1 tok/snone
RTX 4060 Ti16 GB14.4 GBNo~1 tok/snone
RTX 5070 Ti16 GB14.4 GBNo~2 tok/snone
RTX 4070 Ti SUPER16 GB14.4 GBNo~2 tok/snone
RTX 508016 GB14.4 GBNo~2 tok/snone
RTX 309024 GB21.6 GBTight~4 tok/snone
RTX 409024 GB21.6 GBTight~5 tok/snone
RTX 5090 (this card)32 GB28.8 GBYes~32 tok/s16k

Same engine as the verdict above: 90% of VRAM usable, KV-cache at fp16, bandwidth-derived tok/s. Verdicts of the other cards are computed for Qwen3.8 27B (Q8) Q8_0 exactly.

Quant explorer

Switch between the quality-gated builds tracked for this exact combo. Q4_K_M stays the default recommendation; heavier Q6/Q8 builds only appear when their exact Ollama tags are registry-verified.

ModelFit engine estimate
Verdict
Runs
Est. speed
~32 tok/s
First token
~0.5s · Instant
Safe context
16k
B · 6 Comfortable fit

Why no 2-bit builds: Q1/Q2-class quants can look attractive in a memory table, but their quality loss is large enough that ModelFit excludes them from rankings instead of inflating the catalog with junk options. Usable VRAM: 28.8 GB.

Workload verdicts

Qwen3.8 27B (Q8) on the RTX 5090, graded per use case from the model's registry-verified tuning and the engine's speed estimate for this exact combo.

ModelFit engine estimate
ChatA~32 tok/s est. vs ~20 needed for chat.
CodingA~32 tok/s est. vs ~15 needed for coding.
Agentic codingB~32 tok/s est. vs ~30 needed for agentic coding.
ReasoningC~32 tok/s est. vs ~12 needed for reasoning; not a reasoning-tuned model.
RAGC~32 tok/s est. vs ~20 needed for rag; 32k context does not fit.

Grades combine tag-verified tuning (a model not built for the workload caps at C) with the tok/s floor each workload needs to feel usable. A combo that partially offloads caps at C; one that does not fit is D everywhere.

Memory math: weights + context vs budget

Weights take 27.1 GB. Context costs extra KV-cache on top; this is where long-context sessions break on cards that technically fit the weights.

Weights 27 GBKV cache · 16k context 1.0 GBHeadroom 0.7 GBRuntime reserve 3.2 GB

The model leaves about 0.7 GB of the usable VRAM budget free after weights and 16k context.

ContextKV-cacheTotalFits
8k tokens0.5 GB27.6 GBFits
16k tokens1.0 GB28.1 GBFits
32k tokens2.0 GB29.1 GBOver
64k tokens4.0 GB31.1 GBOver
128k tokens8.0 GB35.1 GBOver

KV-cache figures assume an fp16 cache, the llama.cpp/Ollama default. Standard GQA models use a size-class estimate (8 KV heads x 128 head dim class); hybrid linear-attention models (Qwen3.5/3.6, Qwen3-Next) use the exact per-token cost from their published config, since only their sparse full-attention layers cache KV. A q8_0 KV cache roughly halves either figure. Estimates, not measurements.

See how fast it feels

A deterministic typing simulation for Qwen3.8 27B (Q8): first token ~0.5s (instant prefill), then ~32 tokens/sec.

Start the simulation to preview the response pace.

ModelFit engine estimate, not a measured benchmark. Real speed varies with prompt length, thermals, runtime, and KV-cache settings.

Qwen3.8 27B (Q8) on RTX 5090: FAQ

Can the NVIDIA GeForce RTX 5090 run Qwen3.8 27B (Q8)?

Yes. Qwen3.8 27B (Q8) (Q8_0) loads in about 27.1 GB and the RTX 5090 offers 28.8 GB of usable VRAM, leaving headroom for context. Expect at roughly 32 tokens/sec (est.).

How much VRAM does Qwen3.8 27B (Q8) need?

About 27.1 GB for the weights at Q8_0, plus KV-cache for context: roughly 1.0 GB extra at 16k tokens. The RTX 5090 budget is 28.8 GB (32 GB x 90%).

What is the best quantization of Qwen3.8 27B (Q8) for the RTX 5090?

The Q4_K_M build is the highest quality that fits (16.5 GB vs 28.8 GB usable). The Q8_0 build at 27.1 GB leaves more room for long context.

What GPU do I need to run Qwen3.8 27B (Q8) comfortably?

The RTX 5090 already runs Qwen3.8 27B (Q8) comfortably. Larger cards only buy you longer context or a heavier quant.

How much context can Qwen3.8 27B (Q8) use on the RTX 5090?

Up to 16k tokens stay fully in VRAM (28.1 GB total with the KV cache). At 32k tokens the total reaches 29.1 GB and tips over the budget. Quantizing the KV cache to q8_0 roughly halves the KV column and buys back about one context tier.

Is Qwen3.8 27B (Q8) on the RTX 5090 fast enough for coding agents?

Yes: the engine estimates ~32 tok/s against the ~30 tok/s an agentic loop needs to feel responsive, and Qwen3.8 27B (Q8) is tuned for tool-calling.