ChemBERTa

Community · 2020 · Science/Chemistry · Open-source/community

A to Z

A · App: No
B · Built By: Community
C · CEO & Politics: [UNKNOWN]
D · Date: 2020
E · Expertise: Intermediate+
F · Free Tier: Yes
G · Generates: Text only
H · Deployment: Cloud + Local (open weights)
I · Inputs: Text
J · Jurisdiction: Open-source/community
K · Key Staffers: Seyone Chithrananda (Lead author), Gabriel Grand (Co-author), Bharath Ramsundar (Senior author)
L · Languages: English-primary
M · Model Type: Science/Chemistry
N · Safety Issues: None reported
O · Open Source: Yes — open weights
P · Pricing: Free (open weights/code)
Q · AIDb Rating: [UNKNOWN]
R · What Makes It Special: ChemBERTa (2020), a RoBERTa-style transformer from Seyone Chithrananda, Gabriel Grand and Bharath Ramsundar pre-trained as a masked language model on SMILES chemical strings and then fine-tuned to predict molecular properties; one of the first systematic tests of transformers on this task, it scaled well with pre-training data, gave competitive MoleculeNet results and attention maps of important substructures, and came with a 77M-SMILES PubChem pre-training set.
S · Stock / Status: Research / open-source project
T · Training Cutoff: [UNKNOWN]
U · Users: [UNKNOWN]
V · Voice Chat: No
W · Weights: Downloadable
X · X Handle: [UNKNOWN]
Y · Year Founded: [UNKNOWN]
Z · Bottom Line: Open-weights Science/Chemistry from Community, released 2020.

Data completeness 77% · Last verified 2026-05-12 · Primary source ↗

“ChemBERTa.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/chemberta.html