Transformer
Open in the interactive archive →
Download the covers: Floppy card · VHS cover · Vinyl cover
A to Z
- A · App
- No
- B · Built By
- C · CEO & Politics
- Sundar Pichai — Centrist / historically bipartisan
- D · Date
- 2017
- E · Expertise
- Intermediate+
- F · Free Tier
- No free tier
- G · Generates
- Text only
- H · Deployment
- Research
- I · Inputs
- Text
- J · Jurisdiction
- USA
- K · Key Staffers
- Jeff Dean (Chief Scientist), Sundar Pichai (CEO Alphabet)
- L · Languages
- English-primary
- M · Model Type
- LLM
- N · Safety Issues
- None reported
- O · Open Source
- Yes — open weights
- P · Pricing
- Free (open source, Apache 2.0)
- Q · AIDb Rating
- 4/10 · AIDb v2.0 (rule-based): Capability 4/10 · Currency 4/10 · Access 7/10 · Significance 4/10 → 4.45
- R · What Makes It Special
- The Transformer, the neural network architecture introduced in Google researchers' June 2017 paper Attention Is All You Need: it dropped recurrence and convolutions and relied solely on attention, which made training more parallelizable and much faster. It scored 28.4 BLEU on WMT 2014 English-German translation, over 2 BLEU above prior bests, ensembles included, set a single-model record of 41.8 BLEU on English-French after 3.5 days on eight GPUs, and also handled English constituency parsing.
- S · Stock / Status
- $344 (GOOGL, Sep 25, 2026)
- T · Training Cutoff
- [UNKNOWN]
- U · Users
- [UNKNOWN]
- V · Voice Chat
- No
- W · Weights
- Downloadable
- X · X Handle
- Y · Year Founded
- [UNKNOWN]
- Z · Bottom Line
- Open-weights LLM from Google, released 2017.
Data completeness 88% · Last verified 2026-06-11 · Primary source ↗
Cite this
“Transformer.” AIDb — The AI Database. Verified 2026-06-11. https://theaidatabase.com/m/transformer-google.html
More from Google
ALBERT · Bard · BERT · BERT-Large · ByT5 · CoAtNet · Deep Dream Generator · EfficientNet