RoBERTa

Meta AI · 2019 · LLM · USA

A to Z

A · App: No
B · Built By: Meta AI
C · CEO & Politics: Mark Zuckerberg — Centrist / shifted right 2024–26; accommodative of Trump admin; July 2026 WSJ op-ed on distributed superintelligence
D · Date: 2019
E · Expertise: Intermediate+
F · Free Tier: Yes
G · Generates: Text only
H · Deployment: Cloud + Local (open weights)
I · Inputs: Text
J · Jurisdiction: USA
K · Key Staffers: Alexandr Wang (Chief AI Officer, Meta Superintelligence Labs), Nat Friedman (MSL co-lead), Chris Cox (Chief Product Officer)
L · Languages: English-primary
M · Model Type: LLM
N · Safety Issues: None reported
O · Open Source: Yes — open weights
P · Pricing: Free (open weights, MIT)
Q · AIDb Rating: [UNKNOWN]
R · What Makes It Special: Meta AI's RoBERTa (Robustly Optimized BERT Pretraining Approach), from a replication study of BERT pretraining that measured the impact of key hyperparameters and training-data size and found BERT was significantly undertrained; the resulting model set state-of-the-art results on GLUE, RACE and SQuAD, and the models and code were released.
S · Stock / Status: $752 (META, Sep 25, 2026)
T · Training Cutoff: [UNKNOWN]
U · Users: [UNKNOWN]
V · Voice Chat: No
W · Weights: Downloadable
X · X Handle: @AIatMeta
Y · Year Founded: [UNKNOWN]
Z · Bottom Line: Open-weights LLM from Meta AI, released 2019.

Data completeness 85% · Last verified 2026-08-09 · Primary source ↗

“RoBERTa.” AIDb — The AI Database. Verified 2026-08-09. https://theaidatabase.com/m/roberta.html