Run Qwen3.8-27B Locally: 24GB Mac and GPU Guide (2026)

Qwen released Qwen3.8-27B in mid-August 2026, and the community adopted it fast. The unsloth GGUF passed 1,945,635 downloads in about three days (HuggingFace API, 2026). The model is a dense 27B vision-language model under Apache-2.0 with a native 262,144-token context (model card, 2026). A Q4 quant is about 17.8GB, so a 24GB Mac or GPU handles it, and AMD published day-0 numbers of 24.5 tok/s on Ryzen AI Max+ 395 (AMD, 2026). This guide covers the three install paths, the RAM math, and what to expect on 16GB machines.

TL;DR: Qwen3.8-27B is a dense 27B vision-language model under Apache-2.0 with 262,144-token context and MTP decoding. The Q4 build is about 17.8GB, so a 24GB Mac or GPU runs it comfortably, and AMD measured 24.5 tok/s on Ryzen AI Max+ 395. One command to start: ollama run qwen3.8:27b.

What Makes Qwen3.8-27B Different?

Qwen3.8-27B is the flagship dense model of the Qwen3.8 generation, and it is the first Qwen of this size with native image and video understanding. The official card reports 27B parameters, 64 layers, and a hidden dimension of 5120 (Qwen model card, 2026). It supports thinking mode with a reasoning_effort control, and it was trained with MTP, multi-token prediction, which speeds up speculative decoding.

Those are publisher-reported figures from Qwen's own card, not independent results. ModelFit runs no benchmarks of its own, so treat them as vendor claims until third-party leaderboards catch up. The jump from Qwen3.6-27B to Qwen3.8-27B on agentic coding is the headline: +9.6 points on Terminal Bench 2.1 and +8.2 on SWE-bench Pro, both per the same card.

How Much RAM Does a 24GB Machine Give You?

On a 24GB Mac, macOS and open apps leave roughly 19-20GB for the model, the same budget the best LLM for Mac Mini M4 24GB guide uses. Qwen3.8-27B at Q4_K_M downloads as a 17.77GB file (bartowski quants, 2026), and the Ollama manifest shows a 15.7GiB model blob plus a 0.9GiB vision projector (registry manifest, 2026). Add context memory, and a 24GB machine is the smallest tier where Q4 runs without juggling.

Quant file sizes measured from the HuggingFace API, August 2026. ModelFit estimates remain labeled as such elsewhere; file sizes are measurements.

AMD reaches the same conclusion from the hardware side. Its day-0 blog says Qwen3.8-27B "requires roughly 24GB of variable graphics memory (VGM) or VRAM to run comfortably" (AMD, 2026). A 32GB machine gets comfortable headroom for long agent tasks; a 16GB machine should stay on the IQ2 build covered below.

How to Install Qwen3.8-27B with Ollama

The Ollama tag landed the same week as the weights, and the registry probe returns 200 for qwen3.8:27b, qwen3.8:latest, and the MLX port qwen3.8:27b-mlx (Ollama library, 2026). One command installs it:

ollama run qwen3.8:27b

The vision projector ships inside the same manifest, so image prompts work without extra files. A recent Ollama release candidate, v0.32.14-rc0, also added WebP image transcoding for llama-server and a Qwen renderer fix (release notes, 2026), which smooths exactly the multimodal workflow this model unlocks.

How to Run Qwen3.8-27B on Apple Silicon with MLX

Apple Silicon users have a native 4-bit port: mlx-community/Qwen3.8-27B-4bit, built with mlx-vlm 0.6.8, totaling about 15.0GiB across three shards (MLX port, 2026). MLX reads the same files with less memory than a GGUF running through translation, which makes the 24GB Mac class feel comfortable and pushes a 16GB machine to borderline.

python -m mlx_vlm generate --model mlx-community/Qwen3.8-27B-4bit --max-tokens 512

MLX is the path if you plan to feed the model images as part of an agent loop. The port includes the image encoder, and the workflow matches the other models that run well on Apple Silicon.

How to Run It with llama.cpp and MTP

The bartowski imatrix quants add the MTP draft head at Q4_0, so llama.cpp users get speculative decoding with --spec-type draft-mtp (bartowski quants, 2026). Those quants were built with llama.cpp b10419 or newer, so update before downloading. The vision projector ships as separate mmproj files, which means the same quant works in llama.cpp, LM Studio, and koboldcpp as a full VLM.

Sizes from the bartowski Qwen3.8-27B-GGUF card and file tree (2026).

How Fast Is Qwen3.8-27B?

AMD measured up to 24.5 tok/s on a Ryzen AI Max+ 395 and up to 51.8 tok/s on a single Radeon AI PRO R9700, both through llama.cpp Vulkan with MTP enabled (AMD, 2026). Those are vendor measurements on official hardware, not ModelFit tests, and the two MTP settings differ (MTP=4 on the Ryzen, MTP=2 on the Radeon). A 120GB/s M4-class chip will land well below the Ryzen figure, because dense 27B decoding is bandwidth-bound. Until community benchmarks land, treat anything faster as an unverified claim.

Can You Run Qwen3.8-27B on a 16GB Mac?

Yes, in a reduced form. The IQ2_XXS quant is 9.39GB (bartowski quants, 2026), small enough to load on 16GB, but a 27B model at 2-bit loses visible quality, and the vision projector adds another 0.9GB on top. Community threads also report that the default high reasoning effort produces very long outputs, which eats context and slowdowns on small machines (r/LocalLLaMA, 2026). If you own a 16GB machine, prefer the lighter Qwen3.5 9B or wait for dedicated small quants.

FAQ

Can a 16GB Mac run Qwen3.8-27B?

Only the IQ2_XXS build fits, at 9.39GB, and quality drops noticeably at 2-bit. A Q4 build needs about 18GB, which is why 24GB is the recommended entry tier.

Is Qwen3.8-27B multimodal?

Yes. It is a native vision-language model that understands images and video, per the official card. The Ollama manifest bundles the vision projector, and MLX and llama.cpp ports ship it too.

What license does Qwen3.8-27B use?

Apache-2.0, the same permissive license as Qwen3.5 and Qwen3.6. Commercial use and modification are allowed without a paid license.

Is the 262K context usable on a 24GB machine?

The context is native, but the KV cache is proportional to context length. At 262K tokens a 24GB machine runs out of room, so expect to work with smaller context windows or a 32GB+ machine for long agent sessions.

The Short Version

Qwen3.8-27B is the strongest dense open-weight model of its size for a 24GB machine, and it arrived with working install paths on day one. Start with ollama run qwen3.8:27b, use the MLX 4-bit port on Apple Silicon, and prefer llama.cpp b10419+ if you want MTP decoding. For the cloud-scale sibling, see what Qwen3.8-Max would cost to run, and for the wider family history start at the Qwen3.5 medium series hub. If coding is your main workload, the local coder comparison shows how the 27B class stacks up against faster MoE alternatives.