AudioLDM 2
Open in the interactive archive →
Download the covers: Floppy card · VHS cover · Vinyl cover
A to Z
- A · App
- No
- B · Built By
- Community
- C · CEO & Politics
- N/A (academic research) — No public partisan activity documented
- D · Date
- 2023
- E · Expertise
- Intermediate+
- F · Free Tier
- Yes
- G · Generates
- Text only
- H · Deployment
- Cloud + Local (open weights)
- I · Inputs
- Text
- J · Jurisdiction
- International
- K · Key Staffers
- Haohe Liu (Lead and corresponding author), Mark D. Plumbley (Senior author)
- L · Languages
- English-primary
- M · Model Type
- Audio Generation
- N · Safety Issues
- Synthetic audio risks: voice cloning or impersonation misuse, copyright/style imitation concerns, and possible unsafe or biased outputs depending on deployment safeguards.
- O · Open Source
- Yes — open weights
- P · Pricing
- Free for non-commercial use (open weights, CC BY-NC-SA 4.0)
- Q · AIDb Rating
- [UNKNOWN]
- R · What Makes It Special
- AudioLDM 2 (August 2023), an open audio generation framework that uses one learning method for speech, music and sound effects: AudioMAE turns any audio into a 'language of audio' (LOA), a GPT-2 model translates text and other inputs into LOA, and a latent diffusion model conditioned on LOA generates the sound, with state-of-the-art or competitive results on text-to-audio, text-to-music and text-to-speech benchmarks. Its code also does super-resolution and inpainting; a 48 kHz model followed.
- S · Stock / Status
- N/A (academic)
- T · Training Cutoff
- [UNKNOWN]
- U · Users
- [UNKNOWN]
- V · Voice Chat
- No
- W · Weights
- Downloadable
- X · X Handle
- [UNKNOWN]
- Y · Year Founded
- [UNKNOWN]
- Z · Bottom Line
- Open-weights Audio Generation from Community, released 2023.
Data completeness 81% · Last verified 2026-05-12 · Primary source ↗
Cite this
“AudioLDM 2.” AIDb — The AI Database. Verified 2026-05-12. https://theaidatabase.com/m/audioldm-2.html
More from Community
AceGPT · Aider · AnimateDiff · Automatic1111 · BioMistral · ChemBERTa · ColPali · ComfyUI