PubMedBERT
Open in the interactive archive →
Download the covers: Floppy card · VHS cover · Vinyl cover
A to Z
- A · App
- No
- B · Built By
- Microsoft
- C · CEO & Politics
- Satya Nadella — Centrist / moderate
- D · Date
- 2020
- E · Expertise
- Intermediate+
- F · Free Tier
- Yes
- G · Generates
- Text only
- H · Deployment
- Cloud + Local (open weights)
- I · Inputs
- Text
- J · Jurisdiction
- USA
- K · Key Staffers
- Mustafa Suleyman (CEO Microsoft AI), Kevin Scott (CTO)
- L · Languages
- English-primary
- M · Model Type
- Science/Biology
- N · Safety Issues
- None reported
- O · Open Source
- Yes — open weights
- P · Pricing
- Free (open weights, MIT)
- Q · AIDb Rating
- [UNKNOWN]
- R · What Makes It Special
- Microsoft Research's PubMedBERT, now named BiomedBERT (July 2020), a BERT model pretrained from scratch on PubMed abstracts (and, in one version, PubMed Central full-text articles), from research showing that in text-rich domains such as biomedicine, pretraining from scratch beats continual pretraining of general-domain models; it set state-of-the-art results across biomedical NLP and came with the BLURB benchmark and leaderboard. MIT license.
- S · Stock / Status
- $516 (MSFT, Sep 25, 2026)
- T · Training Cutoff
- [UNKNOWN]
- U · Users
- [UNKNOWN]
- V · Voice Chat
- No
- W · Weights
- Downloadable
- X · X Handle
- @Microsoft
- Y · Year Founded
- [UNKNOWN]
- Z · Bottom Line
- Open-weights Science/Biology from Microsoft, released 2020.
Data completeness 85% · Last verified 2026-05-12 · Primary source ↗
Cite this
“PubMedBERT.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/pubmedbert.html
More from Microsoft
BEiT · Bing Chat / Copilot · Bing Copilot · BioGPT · BitNet b1.58 2B4T · Copilot (consumer) · Copilot App · DeBERTa v3