cpu

16 Oct 2026 · ia, llama.cpp, cpu · 5 min

Running a language model on CPU with llama.cpp

llama.cpp runs a whole language model on a CPU with no GPU: a 17 MB binary, a 468 MiB quantized model, and about 50 tokens per second of generation. The script downloads, measures and tests it.