ModernBERT
Open in the interactive archive →
Download the covers: Floppy card · VHS cover · Vinyl cover
A to Z
- A · App
- No
- B · Built By
- Community
- C · CEO & Politics
- Jeremy Howard — No public partisan activity documented
- D · Date
- 2024
- E · Expertise
- Intermediate+
- F · Free Tier
- Yes
- G · Generates
- Text only
- H · Deployment
- Cloud + Local (open weights)
- I · Inputs
- Text
- J · Jurisdiction
- Open-source/community
- K · Key Staffers
- Benjamin Warner (Core author), Antoine Chaffin (Core author), Benjamin Clavié (Core author), Iacopo Poli (Senior author)
- L · Languages
- English-primary
- M · Model Type
- LLM
- N · Safety Issues
- None reported
- O · Open Source
- Yes — open weights
- P · Pricing
- Free (open weights, Apache 2.0)
- Q · AIDb Rating
- [UNKNOWN]
- R · What Makes It Special
- ModernBERT (December 2024) from Answer.AI and LightOn, a modernized BERT-style encoder-only model pre-trained on 2 trillion tokens of English and code with a native 8,192-token context, using rotary position embeddings, alternating local-global attention, unpadding and Flash Attention; in base (149M parameters) and large (395M) sizes, its authors report state-of-the-art classification and retrieval results, including on code, and the best speed and memory efficiency of any encoder. Apache 2.0.
- S · Stock / Status
- Research / open-source project
- T · Training Cutoff
- [UNKNOWN]
- U · Users
- [UNKNOWN]
- V · Voice Chat
- No
- W · Weights
- Downloadable
- X · X Handle
- @answerdotai
- Y · Year Founded
- [UNKNOWN]
- Z · Bottom Line
- Open-weights LLM from Community, released 2024.
Data completeness 85% · Last verified 2026-05-12 · Primary source ↗
Cite this
“ModernBERT.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/modernbert.html
More from Community
AceGPT · Aider · AnimateDiff · AudioLDM 2 · Automatic1111 · BioMistral · ChemBERTa · ColPali