SciBERT

Allen AI · 2019 · Science NLP · USA

A to Z

A · App: No
B · Built By: Allen AI
C · CEO & Politics: Ali Farhadi — Centrist / academic
D · Date: 2019
E · Expertise: Intermediate+
F · Free Tier: Yes
G · Generates: Text only
H · Deployment: Cloud + Local (open weights)
I · Inputs: Text
J · Jurisdiction: USA
K · Key Staffers: Iz Beltagy (Lead author), Kyle Lo (Co-author), Arman Cohan (Co-author)
L · Languages: English-primary
M · Model Type: Science NLP
N · Safety Issues: None reported
O · Open Source: Yes — open weights
P · Pricing: Free (open weights, Apache 2.0)
Q · AIDb Rating: [UNKNOWN]
R · What Makes It Special: Ai2's SciBERT, a BERT-based language model pretrained on a large multi-domain corpus of scientific publications to improve scientific NLP; Ai2 reported statistically significant gains over BERT and new state-of-the-art results on several tasks, including sequence tagging, sentence classification and dependency parsing, and released the code and models.
S · Stock / Status: Non-profit
T · Training Cutoff: [UNKNOWN]
U · Users: [UNKNOWN]
V · Voice Chat: No
W · Weights: Downloadable
X · X Handle: @allen_ai
Y · Year Founded: [UNKNOWN]
Z · Bottom Line: Open-weights Science NLP from Allen AI, released 2019.

Data completeness 85% · Last verified 2026-05-12 · Primary source ↗

“SciBERT.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/scibert.html