Music Generation

Music Generation Skill

Domain: AI Music Generation
Version: 1.0.0
Last Updated: 2026-04-15
Author: the AI assistant (your AI assistant)
Source: Patterns from AlexVideos CLI toolkit
Related: text-to-speech (voice), video-generation (video)

Overview

Generate AI music and soundtracks via Replicate. 5 models covering lyrics-based songs, instrumental tracks, and professional sound design.

Model Catalog (5 Models)

Parameter Support Matrix

Model Selection Guide

Lyrics Format (MiniMax Music 1.5)

Use structured tags for song sections:

[intro]
(Soft piano melody)

[verse]
Walking through the city lights at night
Every shadow tells a different story
Searching for a meaning in the dark
Finding hope in unexpected places

[chorus]
We rise above the noise
Breaking through the silence
Every heart beating as one
Together we are stronger

[bridge]
When the world falls apart around us
We'll find our way back home

[outro]
(Fade out with gentle strings)

Generation Examples

Song with Lyrics (MiniMax)

const output = await replicate.run("minimax/music-1.5", {
  input: {
    prompt: "Uplifting pop rock song about finding hope",
    lyrics: `
[verse]
Walking through the rain...
[chorus]
We are the dreamers...
    `,
  },
});

Instrumental (Stable Audio)

const output = await replicate.run("stability-ai/stable-audio-2.5", {
  input: {
    prompt: "Epic cinematic orchestral score, heroic theme, brass and strings",
    duration: 60, // seconds
    negative_prompt: "vocals, singing, speech, drums",
  },
});

Reference-Based (MiniMax 01)

const output = await replicate.run("minimax/music-01", {
  input: {
    prompt: "Upbeat electronic dance track",
    reference_audio: referenceAudioDataURI, // Sample to match style
  },
});

Professional with Vocals Toggle (ElevenLabs)

const output = await replicate.run("elevenlabs/music", {
  input: {
    prompt: "Energetic pop song with catchy hook",
    include_vocals: true, // or false for instrumental
  },
});

Prompt Engineering

Cost Comparison (60s track)

Integration with Studio Agents

• Video Generation: Background music for generated videos
• Text-to-Speech: Combine speech with background tracks
• Video Editing: Merge music with video via avmerge

Common Use Cases

Output Handling

import { writeFileSync } from "fs";

// Music typically returns MP3 or WAV
const response = await fetch(output);
const buffer = await response.arrayBuffer();
writeFileSync("output.mp3", Buffer.from(buffer));