IndexMapAnti-DoomscrollAbout
ConceptCross-Modal

Music Generation Models

Also known as: Text-to-music · AI music generation · MusicLM · MusicGen · Lyria · Stable Audio

Plain English

Music generation models make audio from prompts, melodies, or other references. The result can be an instrumental clip, a full song with vocals, or audio that a producer edits into a separate project.

Technical Overview

Some models predict sequences from audio codecs, while others denoise compressed waveforms with latent diffusion. Conditioning can specify melody, instrumentation, lyrics, structure, or duration. Model comparison should distinguish audio fidelity from musical coherence over longer passages and account for each release’s weight and output terms.

Timeline (4)

RSS
  1. 2023

    Paper

    Google presented MusicLM, which generates musical audio through a hierarchy of semantic and acoustic tokens. The conditioning lets the model follow a text description while retaining a reference melody.

  2. Paper

    Meta described MusicGen, which interleaves multiple audio-codec streams in a single Transformer. This makes text and melody conditioning possible without a separate autoregressive model for each stage.

  3. 2026

See also (4)

Open full graph