Model record

Qwen3 8B

Alibaba Cloud · Apache 2.0 · verified

Architecture Dense
Parameters 8.2B dense
Context 32,768 tokens
Deployment tier Consumer
Starting memory 8 GB
Recommended 16 GB

What this model is

The architecture is dense. Every parameter is part of the active path, so memory and speed scale with the full model rather than a smaller expert subset.

Memory and quantization

Decimal GB, rounded from the Ollama tag page. Runtime memory still needs KV cache and overhead.

Quantization Published files 8K estimate
Q4_K_M 5.20 GB 7.91 GB
Q8_0 8.90 GB 11.61 GB

Estimate formula: published weight files + 1.2080 GB per 8K tokens × context / 8K + 1.5 GB runtime overhead. Sizes are decimal GB, not GiB. At 8K context, the smallest listed build is about 7.9 GB before OS and application reserve.

Conservative FP16 estimate from the standard Qwen3 GQA configuration; not a runtime measurement.

KV method source: https://ollama.com/library/qwen3

Speed heuristic

Speed depends on quantization, backend, and hardware; no single measured value is reported

Active path: 8.2B parameters. This is a relative speed signal only; it is not a tokens/sec benchmark.

Runtimes

  • Ollama
  • llama.cpp
ollama run qwen3:8b

License restrictions

Apache 2.0 permits commercial use and modification; retain notices and comply with the patent and termination terms.

This is a plain-language summary, not legal advice. Read the linked license before commercial deployment or redistribution.

Known issues

  • Output quality and speed vary by quantization

Sources

This page is an independent compatibility guide, not official documentation. Verify the primary source before downloading or deploying a model.