News

Qwen3.8-27B Is Out, and It's a GPU Model

August 14, 2026

r/LocalLLaMA is having a moment over Alibaba's new Qwen3.8-27B, and it's easy to see why on paper: a dense 27B model with native image and video understanding, a 256K context window, and Apache 2.0 licensing, released with day-0 support already in llama.cpp, Ollama, LM Studio, and Jan. That's a genuinely strong release. It's also not a model most people reading this site can just casually run - so let's talk about what it actually takes.

What it actually is

Qwen3.8-27B is a dense model (not a mixture-of-experts setup like some recent Qwen releases), built around a hybrid attention architecture Alibaba is using across its newer models. The headline feature is that it's natively multimodal - it reads images and video directly, not through a bolted-on separate vision model - and its 256K native context window can be stretched to 1 million tokens with RoPE scaling if you have the memory to back it up.

The benchmark numbers being passed around are legitimately good: a SWE-bench Pro score in the low 60s for real-world coding tasks, and an OSWorld-Verified score in the mid-80s - that second one measures how well a model can actually operate a computer (clicking, navigating, reading a screen), not just answer questions about one. That's the kind of number that gets a subreddit excited.

The hardware reality

If you're running the CPU-only mini PC setup this site defaults to, the honest answer is: it'll load, but not comfortably.

This is a dense 27B model, which means the full model sits in memory - there's no mixture-of-experts trick that only activates a fraction of it at once. Rough VRAM math across quantization levels:

~56GB Full precision (BF16) Data-center GPU territory - an H100 or similar.

~28GB FP8 Still needs a 32GB-class card like an RTX 5090.

~17GB 4-bit quantized The realistic consumer floor - an RTX 4090/5090, or equivalent unified memory.

That 4-bit number lines up with what Ollama's own library listing shows: the default qwen3.8 tag comes in around 18GB. And that's before accounting for KV cache overhead from that huge context window - if you're running long conversations or feeding it large documents, budget extra headroom rather than cutting it close.

The CPU-only Ryzen 7 mini PC this site recommends by default can technically load this - it just won't be a good time. Ollama can run a model entirely on system RAM instead of VRAM, and 32GB is more than the ~17-18GB the 4-bit weights need. But a dense 27B model doing CPU-only inference is a different animal from the 7-8B models this hardware is actually good at - expect a real slowdown, likely too slow for back-and-forth chat. This isn't a knock on that hardware - it's still the right call for 7-8B models, which cover the vast majority of what most people actually do with local AI. It's just not a comfortable fit for this one.

There is one interesting middle path worth knowing about: AMD's Ryzen AI Max+ chips (the ones with "395" in the name) pair a real GPU die with up to 128GB of unified memory in a mini-PC-sized box, and AMD has published day-0 guidance for running this exact model on them. That's a meaningfully different product than the CPU-only mini PC in the mini PC setup guide - worth knowing about if a model like this is specifically what you're chasing, but it's a different hardware category and a different price point, not a drop-in swap.

For anyone with a real GPU already, or planning the build in the full PC build guide, this is exactly the kind of model that guide's GPU pick is aimed at - a 24GB card gets you a working 4-bit setup with a bit of headroom. Would rather buy a finished machine than build one? The prebuilt RTX 4090 workstation pick covers exactly this tier.

If you do have the hardware

Ollama's library already lists it directly:

ollama run qwen3.8

That pulls the default 4-bit tag at roughly 18GB. If you want to understand what "4-bit" and the other numbers above actually mean before you commit to a download, the Choosing Your First Model guide covers quantization and parameter count from the ground up.

If your hardware isn't there yet, you're not missing out on much day to day. The multimodal and long-context features are genuinely new, but for the core use case most readers here actually have - a private chat interface, a coding assistant, a document Q&A setup - a well-chosen 7-8B model on modest hardware still covers it. Big releases like this are worth watching, not chasing.

Sources: the official Hugging Face model card, AMD's day-0 support blog post, and Ollama's own library listing.