Hardware index

Your machine is part of the answer.

Unified memory and dedicated VRAM are not interchangeable. These profiles keep the distinction explicit.

macOS

Mac mini M4 · 16 GB

16 GB system memory · 16 GB unified memory

Ollama · llama.cpp · MLX

macOS

24 GB system memory · 24 GB unified memory

Ollama · llama.cpp · MLX

macOS

64 GB system memory · 64 GB unified memory

Ollama · llama.cpp · MLX

Windows

32 GB system memory · 16 GB VRAM

Ollama · llama.cpp · CUDA

Linux

64 GB system memory · 24 GB VRAM

Ollama · llama.cpp · CUDA