Pythia

EleutherAI · 2023 · LLM · USA

A to Z

A · App: No
B · Built By: EleutherAI
C · CEO & Politics: Community-led (no CEO) — N/A (open-source community)
D · Date: 2023
E · Expertise: Intermediate+
F · Free Tier: Yes
G · Generates: Text only
H · Deployment: Cloud + Local (open weights)
I · Inputs: Text
J · Jurisdiction: USA
K · Key Staffers: Stella Biderman (Co-lead author), Hailey Schoelkopf (Co-lead author)
L · Languages: English-primary
M · Model Type: LLM
N · Safety Issues: None reported
O · Open Source: Yes — open weights
P · Pricing: Free (open weights, Apache 2.0)
Q · AIDb Rating: [UNKNOWN]
R · What Makes It Special: EleutherAI's Pythia, a suite of language models for research on interpretability, learning dynamics and transparency: eight sizes from 70M to 12B parameters (later plus 14M and 31M), each trained on the Pile or a deduplicated Pile in the same order for about 300B tokens, with 154 checkpoints per model and all models, data and code released.
S · Stock / Status: Non-profit
T · Training Cutoff: [UNKNOWN]
U · Users: [UNKNOWN]
V · Voice Chat: No
W · Weights: Downloadable
X · X Handle: @AiEleuther
Y · Year Founded: [UNKNOWN]
Z · Bottom Line: Open-weights LLM from EleutherAI, released 2023.

Data completeness 85% · Last verified 2026-05-12 · Primary source ↗

“Pythia.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/pythia.html