mGPT
Open in the interactive archive →
Download the covers: Floppy card · VHS cover · Vinyl cover
A to Z
- A · App
- No
- B · Built By
- AI Forever/Sber
- C · CEO & Politics
- Herman Gref — State-linked (Russia); former Russian Economy Minister under Putin (2000-07); under US/EU sanctions since 2022
- D · Date
- 2022
- E · Expertise
- Intermediate+
- F · Free Tier
- Yes
- G · Generates
- Text only
- H · Deployment
- Cloud + Local (open weights)
- I · Inputs
- Text
- J · Jurisdiction
- Russia
- K · Key Staffers
- Oleh Shliazhko (Lead author), Tatiana Shavrina (Senior author)
- L · Languages
- Russian-primary
- M · Model Type
- LLM
- N · Safety Issues
- None reported
- O · Open Source
- Yes — open weights
- P · Pricing
- Free (open weights, Apache 2.0 license)
- Q · AIDb Rating
- [UNKNOWN]
- R · What Makes It Special
- SberDevices' mGPT (published by AI Forever), a multilingual GPT-3-style language model with 1.3B parameters trained on 61 languages from 25 language families using Wikipedia and the C4 corpus (about 600 GB of text, 440 billion tokens) with sparse attention on Megatron and DeepSpeed; it performs on par with Meta's XGLM while covering more languages, including low-resource languages of CIS countries and smaller peoples of Russia, and a 13B version was also trained. Apache 2.0.
- S · Stock / Status
- Public parent (Sberbank; Moscow Exchange: SBER)
- T · Training Cutoff
- [UNKNOWN]
- U · Users
- [UNKNOWN]
- V · Voice Chat
- No
- W · Weights
- Downloadable
- X · X Handle
- [UNKNOWN]
- Y · Year Founded
- [UNKNOWN]
- Z · Bottom Line
- Open-weights LLM from AI Forever/Sber, released 2022.
Data completeness 81% · Last verified 2026-05-12 · Primary source ↗
Cite this
“mGPT.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/mgpt.html