Higgsfield Music-Video Skill
What this skill does
Crafts production-ready music video prompts and routes them to the best Higgsfield model
for beat-synced, audio-driven output. Handles performance videos, narrative videos, abstract
visualizers, lyric videos, and multi-segment assembly for full-length songs.
An audio track is always required. This is a mandatory-audio skill: every generation
needs a user-supplied audio file uploaded and confirmed via the media branch before calling
higgsfield:generate_video. The confirmed audio is attached with role audio.
Model routing
Primary and fallback video models
|
veo3_1 (primary) |
veo3_1_lite (fallback) |
| Rationale |
Native audio generation; best audio-visual sync |
Lower cost; use when primary is unavailable |
| Aspect ratios |
16:9, 9:16 only — no 1:1 |
16:9, 9:16, auto |
| Duration |
4, 6, 8 s — discrete set only |
4, 6, 8 s (same discrete set) |
| Tunable params |
quality {basic, high, ultra}; model {veo-3-1-preview, veo-3-1-fast} |
resolution {720p, 1080p}; generate_audio {true, false, def false} |
| Media roles |
start_image (max 1) |
start_image, end_image |
| Native audio |
Yes |
Basic (via generate_audio param) |
Routing rule: Use veo3_1 by default. Fall back to veo3_1_lite only when the primary
is unavailable. When falling back, inform the user of what they give up: native audio
quality and the veo-3-1-preview quality tier. Never switch silently.
Aspect and duration constraints:
- Neither model supports
1:1 aspect ratio.
- Durations are the discrete set
[4, 6, 8] — do not pass 5, 7, 10, or 15.
- A full music video requires multiple segments (see model-specs.md for planning guidance).
MODEL-06 directive: If a parameter is rejected at generation time, call
higgsfield:models_explore with the target model name to re-verify the live schema. Full
parameter tables: references/model-specs.md.
Prompt-building workflow
Gather intent — Confirm: song genre, visual strategy (performance / narrative /
abstract), target platform, aspect ratio, mood/aesthetic, desired clip duration.
Select model — Apply the routing table above. Use veo3_1 by default.
Build the prompt — Use the craft references below:
- Beat-sync techniques, energy mapping, hook framework, camera techniques:
references/beat-sync.md
- Genre-specific visual language, colors, lighting, trigger words:
references/genres.md
- Master template and worked example prompts:
references/examples.md
Plan segments — Because veo3_1 clips are 4–8 s, map the song's structure to
segments before generating. See references/model-specs.md
for multi-segment planning.
Present for review — Show the assembled prompt and all parameters to the user for
review and refinement before any generation call.
Opt-in generation
Generation costs Higgsfield credits and requires explicit user confirmation before any
generate call. This skill never auto-generates.
Full step-by-step flow (confirmation gate, balance/cost surface, generate → poll →
display): ../../shared/generation-flow.md
This skill's primary model: veo3_1
Media upload — MANDATORY (GEN-04):
An audio track is always required for video generation. Before calling
higgsfield:generate_video:
- Ask the user to provide their audio file.
- Upload it: run
higgsfield:media_upload → returns a pending_id.
- Confirm it: run
higgsfield:media_confirm → returns a confirmed_id.
- Attach it in
input_files with role audio:[{ "id": "<confirmed_id>", "role": "audio" }]
If the user also provides a reference image for the video, add it with role start_image
in the same input_files array:
[
{ "id": "<audio_confirmed_id>", "role": "audio" },
{ "id": "<image_confirmed_id>", "role": "start_image" }
]
Never pass a pending_id directly to input_files — it will be rejected. See
../../shared/generation-flow.md Step 2b for the full
atomic-pair detail.
Tool signatures: ../../shared/mcp-tools.md
Reference materials
| File |
Contents |
| references/model-specs.md |
Per-model parameter tables for veo3_1 and veo3_1_lite; per-platform recommendations; multi-segment assembly note; verification annotation |
| references/beat-sync.md |
Beat-visual synchronization philosophy, 12 music-video hook styles, 7 beat-sync techniques (timing references, energy mapping, frequency-responsive effects, syncopation visuals), energy arc table, performance/narrative/abstract strategies, camera techniques, multi-segment strategy |
| references/genres.md |
Genre visual language guide for 10 genres (hip-hop, pop, rock/metal, EDM, R&B, lo-fi, classical, jazz, country, K-pop) with color palettes, lighting approaches, trigger words, visual hooks, and example prompts |
| references/examples.md |
Master template, 5 worked music-video prompts (hip-hop performance, pop ballad, EDM abstract, R&B narrative, K-pop choreography), lyric video technique table |
1---2name: higgsfield-music-video3description: Generates music video and beat-synced visual content prompts for Higgsfield. An audio track is always required. Routes to veo3_1 (primary, native audio) or veo3_1_lite (fallback). Use when the user wants a music video, lyric video, beat-synced visuals, performance video, concert visual, album art animation, or any music-driven visual content.4---56# Higgsfield Music-Video Skill78## What this skill does910Crafts production-ready music video prompts and routes them to the best Higgsfield model11for beat-synced, audio-driven output. Handles performance videos, narrative videos, abstract12visualizers, lyric videos, and multi-segment assembly for full-length songs.1314**An audio track is always required.** This is a mandatory-audio skill: every generation15needs a user-supplied audio file uploaded and confirmed via the media branch before calling16`higgsfield:generate_video`. The confirmed audio is attached with role `audio`.1718---1920## Model routing2122### Primary and fallback video models2324| | veo3_1 (primary) | veo3_1_lite (fallback) |25|---|---|---|26| **Rationale** | Native audio generation; best audio-visual sync | Lower cost; use when primary is unavailable |27| **Aspect ratios** | `16:9`, `9:16` only — **no `1:1`** | `16:9`, `9:16`, `auto` |28| **Duration** | `4`, `6`, `8` s — **discrete set only** | `4`, `6`, `8` s (same discrete set) |29| **Tunable params** | `quality` {basic, high, ultra}; `model` {veo-3-1-preview, veo-3-1-fast} | `resolution` {720p, 1080p}; `generate_audio` {true, false, def false} |30| **Media roles** | `start_image` (max 1) | `start_image`, `end_image` |31| **Native audio** | Yes | Basic (via `generate_audio` param) |3233**Routing rule:** Use `veo3_1` by default. Fall back to `veo3_1_lite` only when the primary34is unavailable. When falling back, inform the user of what they give up: native audio35quality and the `veo-3-1-preview` quality tier. Never switch silently.3637**Aspect and duration constraints:**38- Neither model supports `1:1` aspect ratio.39- Durations are the discrete set `[4, 6, 8]` — do not pass 5, 7, 10, or 15.40- A full music video requires multiple segments (see model-specs.md for planning guidance).4142**MODEL-06 directive:** If a parameter is rejected at generation time, call43`higgsfield:models_explore` with the target model name to re-verify the live schema. Full44parameter tables: [references/model-specs.md](references/model-specs.md).4546---4748## Prompt-building workflow49501. **Gather intent** — Confirm: song genre, visual strategy (performance / narrative /51 abstract), target platform, aspect ratio, mood/aesthetic, desired clip duration.52532. **Select model** — Apply the routing table above. Use `veo3_1` by default.54553. **Build the prompt** — Use the craft references below:56 - Beat-sync techniques, energy mapping, hook framework, camera techniques:57 [references/beat-sync.md](references/beat-sync.md)58 - Genre-specific visual language, colors, lighting, trigger words:59 [references/genres.md](references/genres.md)60 - Master template and worked example prompts:61 [references/examples.md](references/examples.md)62634. **Plan segments** — Because veo3_1 clips are 4–8 s, map the song's structure to64 segments before generating. See [references/model-specs.md](references/model-specs.md)65 for multi-segment planning.66675. **Present for review** — Show the assembled prompt and all parameters to the user for68 review and refinement **before** any generation call.6970---7172## Opt-in generation7374Generation costs Higgsfield credits and requires explicit user confirmation before any75generate call. This skill never auto-generates.7677**Full step-by-step flow** (confirmation gate, balance/cost surface, generate → poll →78display): [`../../shared/generation-flow.md`](../../shared/generation-flow.md)7980**This skill's primary model:** `veo3_1`8182**Media upload — MANDATORY (GEN-04):**8384An audio track is always required for video generation. Before calling85`higgsfield:generate_video`:86871. Ask the user to provide their audio file.882. Upload it: run `higgsfield:media_upload` → returns a `pending_id`.893. Confirm it: run `higgsfield:media_confirm` → returns a `confirmed_id`.904. Attach it in `input_files` with role `audio`:91 ```json92 [{ "id": "<confirmed_id>", "role": "audio" }]93 ```9495If the user also provides a reference image for the video, add it with role `start_image`96in the same `input_files` array:97 ```json98 [99 { "id": "<audio_confirmed_id>", "role": "audio" },100 { "id": "<image_confirmed_id>", "role": "start_image" }101 ]102 ```103104Never pass a `pending_id` directly to `input_files` — it will be rejected. See105[`../../shared/generation-flow.md`](../../shared/generation-flow.md) Step 2b for the full106atomic-pair detail.107108**Tool signatures:** [`../../shared/mcp-tools.md`](../../shared/mcp-tools.md)109110---111112## Reference materials113114| File | Contents |115|---|---|116| [references/model-specs.md](references/model-specs.md) | Per-model parameter tables for veo3_1 and veo3_1_lite; per-platform recommendations; multi-segment assembly note; verification annotation |117| [references/beat-sync.md](references/beat-sync.md) | Beat-visual synchronization philosophy, 12 music-video hook styles, 7 beat-sync techniques (timing references, energy mapping, frequency-responsive effects, syncopation visuals), energy arc table, performance/narrative/abstract strategies, camera techniques, multi-segment strategy |118| [references/genres.md](references/genres.md) | Genre visual language guide for 10 genres (hip-hop, pop, rock/metal, EDM, R&B, lo-fi, classical, jazz, country, K-pop) with color palettes, lighting approaches, trigger words, visual hooks, and example prompts |119| [references/examples.md](references/examples.md) | Master template, 5 worked music-video prompts (hip-hop performance, pop ballad, EDM abstract, R&B narrative, K-pop choreography), lyric video technique table |