gnipbao Story to Hand-drawn Video
Use the project renderer through this Skill's scripts/run_story_video.py. Set STORY_VIDEO_PROJECT when the project is not the current working directory. The wrapper must not rely on an author-specific absolute path.
Workflow
- Accept inline Chinese story text, a UTF-8 text file, or ordered local images.
- Preserve the user's wording. For text input, keep one complete sentence as one beat by default and split only long compound sentences at natural narrative turns.
- For uploaded composite pages, automatically crop the handwritten caption and illustration, then derive an aligned black-and-white plate locally.
- In direct-cut mode, keep the order
text → bw_full → color; reveal every stage from left to right. - In page-flip mode, preserve the untouched uploaded master and show it statically before curling the page from the bottom-right corner. Do not add caption, black-and-white, or recoloring stages. Retain a faded version of the source page on the paper underside.
- Keep all illustration marks inside the white safe border. Use contained framing and never
covercropping. - Produce a silent MP4. Voiceover and optional BGM are post-production tasks.
- Report the scene count, duration, output path, and whether the result is plan-only, preview, or final.
Default visual lock
The immutable default style id is colored-pencil-diary. When the user does not request another style, preserve these fixed project resources:
references/target-diary-style.txt: prompt-ready visual grammar.references/style-bw.png: black-and-white mark-making board.references/style-color.png: colored-pencil technique and palette board.references/style-layout.png: full-page caption and composition board.references/style-approved.png: user-approved final-output anchor and default quality bar.
Treat the boards as style evidence only. Ignore their depicted people, actions, props, dates, and Chinese wording. Let the character sheet control identity and continuity. When visual instructions conflict or remain ambiguous, follow style-approved.png for line weight, pencil density, figure scale, facial simplicity, negative space, and final finish.
Match these non-negotiable traits: pure white digital page; blunt wobbly black felt-tip contours; oversized rounded heads and short compact bodies; simple expressive faces; visible short colored-pencil strokes with white gaps; a small dusty-blue, brick-red, charcoal, beige, tan, muted-yellow, and light-gray palette; sparse contextual props and abundant unfilled white space. Avoid anime, vector polish, smooth fills, watercolor, gradients, realistic lighting, paper grain, and dense scenery.
Do not replace or bypass the fixed default resources unless the user explicitly requests a different visual family. The renderer fingerprints the selected recipe and its reference images, so switching styles automatically creates a new generated-asset batch instead of reusing stale images.
Built-in style library
The machine-readable source of truth is <project>/references/handdrawn-style-library.json. Use python3 scripts/run_story_video.py --list-styles to show the current menu. --style accepts the order number, id, Chinese name, English name, or any registered alias. Use the catalog-level contact_sheet and each style's example_image to compare visual families before selection; treat those images as style evidence, not scene or character references.
| # | Style id | 中文名 | Best fit |
|---|---|---|---|
| 1 | colored-pencil-diary |
彩铅日记漫画（默认） | 家庭、生活、纪实情感 |
| 2 | minimal-line-explainer |
极简黑白线条讲解 | 科普、流程、观点 |
| 3 | kid-crayon |
五岁儿童蜡笔坏画 | 童年、亲子、轻喜剧 |
| 4 | rawkid-crayon |
潦草家庭投稿蜡笔 | 家庭连载、温暖日常 |
| 5 | bean-doodle-infographic |
小豆人涂鸦信息图 | 步骤、清单、知识卡 |
| 6 | ms-paint-bad-doodle |
鼠标烂涂鸦 | 吐槽、反转、荒诞 |
| 7 | ballpoint-scribble |
圆珠笔缠绕线速写 | 肖像、动物、独白 |
| 8 | real-crayon-paper |
真实蜡笔纸实拍 | 儿童视角、成长记录 |
| 9 | ink-wash |
水墨写意 | 文化、寓言、感悟 |
| 10 | emotional-watercolor-sketch |
情绪叙事淡彩速写 | 回忆、关系、克制纪实 |
| 11 | retro-gouache-concept |
中古动画水粉概念稿 | 怀旧、城市、温暖剧情 |
| 12 | sunlit-storybook |
暖光童画绘本 | 治愈、童话、亲情 |
| 13 | nordic-gouache-storybook |
北欧低饱和水粉绘本 | 安静日常、自然、睡前故事 |
| 14 | inked-storybook |
墨线淡彩绘本 | 角色、青春、对白 |
| 15 | warm-flat-storybook |
暖色几何扁平绘本 | 关系、品牌、轻科普 |
| 16 | naive-marker-notes |
稚拙马克笔笔记 | 社媒、观点、年轻化内容 |
| 17 | zine-riso-collage |
Zine 孔版拼贴 | 成长、旅行、音乐文化 |
| 18 | organic-contour-doodle |
有机轮廓品牌涂鸦 | 生活方式、餐饮、品牌故事 |
| 19 | whiteboard-explainer |
白板讲解动画 | 教程、商业解释、时间线 |
| 20 | linocut-editorial |
粗粝木刻社论插画 | 社会议题、历史、寓言 |
When the user names a style, use it directly. When the user asks for options without naming one, recommend 3–5 styles based on story content instead of forcing a 20-item clarification. Never blend two recipes unless the user explicitly requests a hybrid. Keep character identity, safe framing, narrative isolation, and text accuracy independent of style.
Only the default style currently has fixed visual reference boards. Other styles are prompt-locked and must not inherit the default colored-pencil boards. Their recipe, caption handwriting, palette, negative constraints, source provenance, and aliases are all stored in the library. Repo-derived recipes retain MIT attribution in <project>/references/handdrawn-styles-LICENSE.txt.
Uploaded images
Preview:
python3 scripts/run_story_video.py \
--images /absolute/01.jpg /absolute/02.jpg \
--title "故事标题" \
--mode preview \
--transition cut
Final direct-cut render:
python3 scripts/run_story_video.py \
--images /absolute/01.jpg /absolute/02.jpg \
--title "故事标题" \
--mode full \
--transition cut \
--page-duration 4.4
Final page-flip render:
python3 scripts/run_story_video.py \
--images /absolute/01.jpg /absolute/02.jpg \
--title "故事标题" \
--mode full \
--transition page-flip \
--transition-sec 0.7
Use --layout auto|composite|full to control how uploaded pages are interpreted.
Story text
Plan without generating images:
python3 scripts/run_story_video.py \
--input /absolute/story.txt \
--title "故事标题" \
--style colored-pencil-diary \
--mode plan
Use a different built-in style:
python3 scripts/run_story_video.py \
--input /absolute/story.txt \
--title "故事标题" \
--style ink-wash \
--mode generate
Prepare Codex Image2 jobs, then import and render:
python3 scripts/run_story_video.py --input /absolute/story.txt --title "故事标题" --mode generate
python3 scripts/run_story_video.py --mode import
python3 scripts/run_story_video.py --mode render
Use --generator codex by default. Use --generator api only when the user explicitly selects the API fallback and OPENAI_API_KEY is available. Use --force only when the user explicitly wants an existing generated batch replaced.
Default to --text-mode font so the user's Chinese wording remains exact. Use --text-mode image2 only when the user explicitly prioritizes source-like handwritten captions and accepts that generated Chinese glyphs may need correction.
For time jumps, ambiguous pronouns, medical scenes, or age-sensitive characters, provide a JSON visual plan keyed by two-digit scene id through --visual-plan.
Output contract
- Text-story final:
<project>/out/picture_silent.mp4 - Text-story preview:
<project>/out/picture_silent-preview.mp4 - Uploaded-image final:
<project>/out/uploaded_picture_silent.mp4 - Uploaded-image preview:
<project>/out/uploaded_picture_silent-preview.mp4 - Resolution: final 1080×1440; preview 720×960
- Codec/audio: H.264, silent
After changing the renderer or style library, run the deterministic style-list command and one plan-only smoke test. Do not spend image-generation credits solely for validation unless the user requests visual samples.