Model record

Phi-4 Mini

Microsoft · MIT · verified

Architecture Dense
Parameters 3.8B dense
Context 131,072 tokens
Deployment tier Consumer
Starting memory 5 GB
Recommended 10 GB

What this model is

The architecture is dense. Every parameter is part of the active path, so memory and speed scale with the full model rather than a smaller expert subset.

Memory and quantization

Decimal GB, rounded from the Ollama tag page. Runtime memory still needs KV cache and overhead.

Quantization Published files 8K estimate
Q4_K_M 2.50 GB 5.07 GB
Q8_0 4.10 GB 6.67 GB

Estimate formula: published weight files + 1.0737 GB per 8K tokens × context / 8K + 1.5 GB runtime overhead. Sizes are decimal GB, not GiB. At 8K context, the smallest listed build is about 5.1 GB before OS and application reserve.

Conservative FP16 estimate from the Phi-4 Mini GQA configuration; not a runtime measurement.

KV method source: https://ollama.com/library/phi4-mini

Speed heuristic

Speed depends on quantization, backend, and hardware; no single measured value is reported

Active path: 3.8B parameters. This is a relative speed signal only; it is not a tokens/sec benchmark.

Runtimes

  • Ollama
  • llama.cpp
ollama run phi4-mini

License restrictions

MIT permits commercial use and modification; preserve the copyright and permission notice.

This is a plain-language summary, not legal advice. Read the linked license before commercial deployment or redistribution.

Known issues

  • Not intended for long-context or highly complex tasks

Sources

This page is an independent compatibility guide, not official documentation. Verify the primary source before downloading or deploying a model.