llama.cpp

Community · 2023 · Inference Engine · Open-source/community

A to Z

A · App: No
B · Built By: Community
C · CEO & Politics: Georgi Gerganov (creator, ggml.ai) — No public partisan activity documented
D · Date: 2023
E · Expertise: Intermediate+
F · Free Tier: Yes
G · Generates: Text only
H · Deployment: On-Device
I · Inputs: Text
J · Jurisdiction: Open-source/community
K · Key Staffers: Georgi Gerganov (creator)
L · Languages: English-primary
M · Model Type: Inference Engine
N · Safety Issues: None reported
O · Open Source: Yes — open weights
P · Pricing: Free (open source, MIT)
Q · AIDb Rating: [UNKNOWN]
R · What Makes It Special: llama.cpp, a dependency-free C/C++ engine built on the ggml library for running LLMs and vision-language models locally or in the cloud, with 1.5-bit to 8-bit integer quantization, Apple silicon (Metal), x86 and RISC-V CPU optimizations, CUDA, HIP, Vulkan, SYCL and other GPU backends, hybrid CPU+GPU inference for models larger than VRAM, a CLI and an OpenAI-compatible server.
S · Stock / Status: N/A (open-source project)
T · Training Cutoff: [UNKNOWN]
U · Users: [UNKNOWN]
V · Voice Chat: No
W · Weights: Downloadable
X · X Handle: @ggml_org
Y · Year Founded: [UNKNOWN]
Z · Bottom Line: Open-weights Inference Engine from Community, released 2023.

Data completeness 85% · Last verified 2026-05-12 · Primary source ↗

“llama.cpp.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/llamacpp.html