Best hardware for Qwen3.5 35B-A3B Instruct

What runs Qwen3.5 35B-A3B Instruct well, from the NVIDIA GeForce RTX 3090 up: every tracked GPU and five current Macs graded with engine-estimated speeds and one clear answer per memory size.

Smallest GPU
NVIDIA GeForce RTX 3090
24 GB · ~71 tok/s est.
Fastest
NVIDIA GeForce RTX 5090
~118 tok/s est.
Runs on a Mac?
Yes
from MacBook Pro M5 Pro 48GB

Qwen3.5 35B-A3B Instruct on every tracked GPU

GPUMemoryVerdictEst. speed
NVIDIA GeForce RTX 509032 GB VRAMRuns well~118 tok/sFull verdict
NVIDIA RTX PRO 6000 Blackwell96 GB VRAMRuns well~118 tok/s
NVIDIA GeForce RTX 409024 GB VRAMRuns well~84 tok/sFull verdict
AMD Radeon RX 7900 XTX24 GB VRAMRuns well~72 tok/s
NVIDIA GeForce RTX 309024 GB VRAMRuns well~71 tok/sFull verdict
AMD Ryzen AI Max+ 395 (Strix Halo)110 GB unified memoryRuns well~24 tok/s
NVIDIA GeForce RTX 508016 GB VRAMTight~57 tok/sFull verdict
NVIDIA GeForce RTX 5070 Ti16 GB VRAMTight~53 tok/sFull verdict
NVIDIA GeForce RTX 4080 SUPER16 GB VRAMTight~48 tok/s
AMD Radeon RX 7900 XT20 GB VRAMTight~45 tok/s
NVIDIA GeForce RTX 4070 Ti SUPER16 GB VRAMTight~44 tok/sFull verdict
NVIDIA GeForce RTX 5060 Ti16 GB VRAMTight~31 tok/s
NVIDIA GeForce RTX 4060 Ti16 GB VRAMTight~21 tok/sFull verdict
NVIDIA GeForce RTX 507012 GB VRAMNo~17 tok/s
NVIDIA GeForce RTX 4070 SUPER12 GB VRAMNo~16 tok/s
NVIDIA GeForce RTX 407012 GB VRAMNo~15 tok/sFull verdict
NVIDIA GeForce RTX 306012 GB VRAMNo~12 tok/sFull verdict
NVIDIA GeForce RTX 40608 GB VRAMNo~9 tok/sFull verdict

Speeds are engine estimates. Smallest tracked card that fits: NVIDIA GeForce RTX 3090 (24 GB).

Qwen3.5 35B-A3B Instruct on current Macs (M5/M6)

MacMemoryVerdictEst. speed
Mac Mini M6 16GB16 GB unified memoryNo~11 tok/s
MacBook Air M5 24GB24 GB unified memoryTight~15 tok/s
MacBook Pro M5 Pro 48GB48 GB unified memoryRuns well~39 tok/s
MacBook Pro M5 Max 128GB128 GB unified memoryRuns well~66 tok/s
Mac Studio M5 Ultra 256GB256 GB unified memoryRuns well~97 tok/s

Unified memory: the RAM budget (~70-85%) is the limit, not a VRAM wall. Current-gen configs only.

Frequently asked questions

What is the smallest GPU that runs Qwen3.5 35B-A3B Instruct well?

The NVIDIA GeForce RTX 3090 (24 GB) is the smallest tracked card where Qwen3.5 35B-A3B Instruct (Q4_K_M) runs comfortably, with ~71 tok/s estimated.

Does Qwen3.5 35B-A3B Instruct run on a Mac?

Yes. Qwen3.5 35B-A3B Instruct runs from the MacBook Pro M5 Pro 48GB (~39 tok/s est.) up; unified memory means the RAM budget, not a VRAM wall, is the limit. Apple Silicon is often the cheapest path to large models.

What is the fastest way to run Qwen3.5 35B-A3B Instruct?

The fastest tracked machine for Qwen3.5 35B-A3B Instruct is the NVIDIA GeForce RTX 5090 at ~118 tok/s estimated. Speed is memory-bandwidth-bound, so high-bandwidth cards win.

Cite this page

ModelFit: Best hardware for Qwen3.5 35B-A3B Instruct (35B, Q4_K_M).
https://modelfit.io/best-hardware-for/qwen3.5-35b-a3b/ (dataset updated 2026-10-13, CC BY 4.0).