AIDbThe AI Database — IMDb for AI Models

DeBERTa v3

Microsoft · 2021 · LLM · USA

DeBERTa v3 floppy-disk dossier card

Open in the interactive archive →

Download the covers: Floppy card · VHS cover · Vinyl cover

A to Z

A · App
No
B · Built By
Microsoft
C · CEO & Politics
Satya Nadella — Centrist / moderate
D · Date
2021
E · Expertise
Intermediate+
F · Free Tier
Yes
G · Generates
Text only
H · Deployment
Cloud + Local (open weights)
I · Inputs
Text
J · Jurisdiction
USA
K · Key Staffers
Mustafa Suleyman (CEO Microsoft AI), Kevin Scott (CTO)
L · Languages
English-primary
M · Model Type
LLM
N · Safety Issues
None reported
O · Open Source
Yes — open weights
P · Pricing
Free (open weights, MIT)
Q · AIDb Rating
6/10 · AIDb v2.0 (rule-based): Capability 6/10 · Currency 4/10 · Access 9/10 · Significance 7/10 → 6.2
R · What Makes It Special
Microsoft's DeBERTaV3 (November 2021), which improves DeBERTa by replacing masked language modeling with ELECTRA-style replaced token detection and adding gradient-disentangled embedding sharing to avoid the 'tug-of-war' between generator and discriminator; DeBERTaV3 Large averaged 91.37% on GLUE, 1.37 points above DeBERTa and 1.91 above ELECTRA, and the multilingual mDeBERTa Base reached 79.8% zero-shot XNLI accuracy. Weights and code are released under the MIT license.
S · Stock / Status
$516 (MSFT, Sep 25, 2026)
T · Training Cutoff
[UNKNOWN]
U · Users
[UNKNOWN]
V · Voice Chat
No
W · Weights
Downloadable
X · X Handle
@Microsoft
Y · Year Founded
[UNKNOWN]
Z · Bottom Line
Open-weights LLM from Microsoft, released 2021.

Data completeness 88% · Last verified 2026-05-12 · Primary source ↗

Cite this

“DeBERTa v3.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/deberta-v3.html

More from Microsoft

BEiT · Bing Chat / Copilot · Bing Copilot · BioGPT · BitNet b1.58 2B4T · Copilot (consumer) · Copilot App · E5