How do I install the Storyboard Av Mix skill?

Run npx skillmds@latest add godot-fun/storyboard-av-mix in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Storyboard Av Mix safe to use?

This skill has not completed SkillMD's automated safety review yet. Capability flags: docs only. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Storyboard Av Mix?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Storyboard Av Mix free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Storyboard Av Mix?

godot-fun (@godot-fun) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Storyboard Av Mix by godot-fun — Agent Skill

Name: Storyboard Av Mix
Rating: 4.2 (5 reviews)
Author: godot-fun

Storyboard Av Mix

Muxes per-shot storyboard video with Chinese and English voice-over by retiming video to match VO duration (setpts), writing Video-Chinese/ and Video-English/ (matched by shot id 01, 02, …). Use when the user wants storyboard A/V mix, storyboard A/V mix, VO dubbing mix, video retime to audio, Video-Chinese, Video-English, bilingual VO on cut video, or batch mux Video/ + Chinese/ + English/.

godot-fun Updated Sep 22, 2026

File contents

Storyboard AV Mix

Take a work directory with per-shot video and bilingual VO. For each shot, retime the video to the full VO duration (audio master), drop original video audio, mux, and write language-specific folders.

Input	Path
Shot video	`<root>/Video/<shot-id>.*`
Chinese VO	`<root>/Chinese/<shot-id>.*`
English VO	`<root>/English/<shot-id>.*`

Output	Path
Chinese mux	`<root>/Video-Chinese/<shot-id>.<video-ext>`
English mux	`<root>/Video-English/<shot-id>.<video-ext>`

Rules

When this skill applies, read and follow skill-dependency-manager — run scripts as documented, install missing tools into .dependency/.

VO timing is immutable. Never stretch, shrink, pad, trim, or atempo the voice-over. Duration of the VO file is the master clock.
Video serves audio. Only change video duration (FFmpeg setpts) so it equals that shot’s VO length, then mux.
Drop all audio from the source video; replace with the VO track. Prefer -c:a copy; if the container cannot hold the VO codec (e.g. WAV→MP4), encode AAC without changing length.
Do not downgrade video. setpts requires a re-encode, but match the source: codec family (H.265 Main10 when source is 10-bit HEVC), pix_fmt, bitrate, color tags, and HDR side data (mastering display / MaxCLL). Copy container + video-stream metadata from the source clip.
Match shots by filename stem (01.mp4 ↔ 01.wav).
Batch only via .ai/storyboard-av-mix/mix.py — do not hand-write FFmpeg mux/retime commands.
Never overwrite inputs under Video/, Chinese/, or English/.

Quick Start

From project root:

.dependency/python/python .ai/storyboard-av-mix/mix.py path/to/<root>

Single language:

.dependency/python/python .ai/storyboard-av-mix/mix.py path/to/<root> --lang chinese

Per shot / language the script:

Probes VO duration (source of truth) and video duration
Applies setpts=PTS*(vo_dur/video_dur) — stretch or compress video only (plus short freeze-tail so video ≥ VO)
Muxes with -shortest so container duration == VO duration
Writes <root>/Video-Chinese| or Video-English/ / <shot-id>.<same-ext>

Layout

<root>/
  Video/
    01.mp4
    02.mp4
  Chinese/
    01.wav
    02.wav
  English/
    01.wav
    02.wav
  Video-Chinese/     # written by this skill
    01.mp4
    02.mp4
  Video-English/
    01.mp4
    02.mp4

Typical <root> is a storyboard-tts audio dir that also has a sibling or nested Video/ of cut clips — confirm the folder that contains Video/, Chinese/, and English/.

Common Flags

Flag	Notes
`root`	Work dir with `Video/`, `Chinese/`, `English/`
`--lang`	`both` (default), `chinese`, `english`

Existing outputs are overwritten. Missing VO for a language → skip that job with a warning. Missing video → skip shot.

Agent Notes

Audio first: if durations disagree, change video, never VO.
Prefer one mix.py run for the whole board.
Re-encode must preserve source quality tags (Main10 / HDR / bitrate) — never force 8-bit H.264.
Chat summary: <root>, jobs done / skipped, paths to Video-Chinese/ and Video-English/.
Upstream VO usually from storyboard-tts; this skill does not synthesize speech.
Missing Python/FFmpeg → populate .dependency/ per skill-dependency-manager, retry same command.

Tests

From repo root:

.dependency/python/python .ai/storyboard-av-mix/test_mix.py

storyboard-tts — bilingual VO under Chinese/ / English/
storyboard — source markdown

Manual CLI examples: cli/storyboard-av-mix.md

---name: storyboard-av-mixdescription: Muxes per-shot storyboard video with Chinese and English voice-over by retiming video to match VO duration (setpts), writing Video-Chinese/ and Video-English/ (matched by shot id 01, 02, …). Use when the user wants storyboard A/V mix, storyboard A/V mix, VO dubbing mix, video retime to audio, Video-Chinese, Video-English, bilingual VO on cut video, or batch mux Video/ + Chinese/ + English/.---# Storyboard AV MixTake a work directory with **per-shot** video and bilingual VO. For each shot, **retime the video to the full VO duration** (audio master), drop original video audio, mux, and write language-specific folders.| Input | Path ||-------|------|| Shot video | `<root>/Video/<shot-id>.*` || Chinese VO | `<root>/Chinese/<shot-id>.*` || English VO | `<root>/English/<shot-id>.*` || Output | Path ||--------|------|| Chinese mux | `<root>/Video-Chinese/<shot-id>.<video-ext>` || English mux | `<root>/Video-English/<shot-id>.<video-ext>` |## RulesWhen this skill applies, read and follow [skill-dependency-manager](../skill-dependency-manager.md) — run scripts as documented, install missing tools into `.dependency/`.1. **VO timing is immutable.** Never stretch, shrink, pad, trim, or `atempo` the voice-over. Duration of the VO file is the master clock.2. **Video serves audio.** Only change video duration (FFmpeg `setpts`) so it equals that shot’s VO length, then mux.3. Drop all audio from the source video; replace with the VO track. Prefer `-c:a copy`; if the container cannot hold the VO codec (e.g. WAV→MP4), encode AAC **without** changing length.4. **Do not downgrade video.** `setpts` requires a re-encode, but match the source: codec family (H.265 Main10 when source is 10-bit HEVC), `pix_fmt`, bitrate, color tags, and HDR side data (mastering display / MaxCLL). Copy container + video-stream metadata from the source clip.5. Match shots by **filename stem** (`01.mp4` ↔ `01.wav`).6. Batch only via `.ai/storyboard-av-mix/mix.py` — do not hand-write FFmpeg mux/retime commands.7. Never overwrite inputs under `Video/`, `Chinese/`, or `English/`.## Quick StartFrom project root:```bash.dependency/python/python .ai/storyboard-av-mix/mix.py path/to/<root>```Single language:```bash.dependency/python/python .ai/storyboard-av-mix/mix.py path/to/<root> --lang chinese```Per shot / language the script:1. Probes VO duration (source of truth) and video duration2. Applies `setpts=PTS*(vo_dur/video_dur)` — stretch or compress **video only** (plus short freeze-tail so video ≥ VO)3. Muxes with `-shortest` so **container duration == VO duration**4. Writes `<root>/Video-Chinese|` or `Video-English/` / `<shot-id>.<same-ext>`## Layout```<root>/ Video/ 01.mp4 02.mp4 Chinese/ 01.wav 02.wav English/ 01.wav 02.wav Video-Chinese/ # written by this skill 01.mp4 02.mp4 Video-English/ 01.mp4 02.mp4```Typical `<root>` is a [storyboard-tts](../storyboard-tts/SKILL.md) audio dir that also has a sibling or nested `Video/` of cut clips — confirm the folder that contains `Video/`, `Chinese/`, and `English/`.## Common Flags| Flag | Notes ||------|--------|| `root` | Work dir with `Video/`, `Chinese/`, `English/` || `--lang` | `both` (default), `chinese`, `english` |Existing outputs are overwritten. Missing VO for a language → skip that job with a warning. Missing video → skip shot.## Agent Notes1. Audio first: if durations disagree, change **video**, never VO.2. Prefer one `mix.py` run for the whole board.3. Re-encode must preserve source quality tags (Main10 / HDR / bitrate) — never force 8-bit H.264.4. Chat summary: `<root>`, jobs done / skipped, paths to `Video-Chinese/` and `Video-English/`.5. Upstream VO usually from [storyboard-tts](../storyboard-tts/SKILL.md); this skill does not synthesize speech.6. Missing Python/FFmpeg → populate `.dependency/` per skill-dependency-manager, retry same command.## TestsFrom repo root:```bash.dependency/python/python .ai/storyboard-av-mix/test_mix.py```## Related- [storyboard-tts](../storyboard-tts/SKILL.md) — bilingual VO under `Chinese/` / `English/`- [storyboard](../storyboard/SKILL.md) — source markdownManual CLI examples: [cli/storyboard-av-mix.md](../../../cli/storyboard-av-mix.md)

Frequently asked questions