Model record
Qwen3 8B
Alibaba Cloud · Apache 2.0 · verified
What this model is
The architecture is dense. Every parameter is part of the active path, so memory and speed scale with the full model rather than a smaller expert subset.
Memory and quantization
Decimal GB, rounded from the Ollama tag page. Runtime memory still needs KV cache and overhead.
| Quantization | Published files | 8K estimate |
|---|---|---|
| Q4_K_M | 5.20 GB | 7.91 GB |
| Q8_0 | 8.90 GB | 11.61 GB |
Estimate formula: published weight files + 1.2080 GB per 8K tokens × context / 8K + 1.5 GB runtime overhead. Sizes are decimal GB, not GiB. At 8K context, the smallest listed build is about 7.9 GB before OS and application reserve.
Conservative FP16 estimate from the standard Qwen3 GQA configuration; not a runtime measurement.
KV method source: https://ollama.com/library/qwen3
Speed heuristic
Speed depends on quantization, backend, and hardware; no single measured value is reported
Active path: 8.2B parameters. This is a relative speed signal only; it is not a tokens/sec benchmark.
Runtimes
- Ollama
- llama.cpp
ollama run qwen3:8b License restrictions
Apache 2.0 permits commercial use and modification; retain notices and comply with the patent and termination terms.
This is a plain-language summary, not legal advice. Read the linked license before commercial deployment or redistribution.
Known issues
- Output quality and speed vary by quantization
Sources
This page is an independent compatibility guide, not official documentation. Verify the primary source before downloading or deploying a model.