Chanjing Platform for FrameVideo
When To Use
Use this skill for:
- 数字人视频 — 生成蝉镜平台数字人主持视频
- AI Creation 资产 — 使用蝉镜 AIGC 生成图片/视频素材
- 平台音乐/音效 — 下载蝉镜平台背景音乐和音效
- OAuth 认证 — 检查/设置蝉镜平台认证
- 资产集成 — 将蝉镜生成的资产接入 FrameVideo composition
Do NOT Use
Avoid this skill for:
- 本地 TTS — 使用
framevideo-media(Kokoro TTS) - 本地音频处理 — 使用
framevideo-media(transcribe, remove-background) - Composition HTML 编写 — 使用
framevideo - SSML 语音标记 — 使用
framevideo-voiceover-ssml
Quick Start
场景 1: 生成数字人视频
# 1. 检查认证
npx framevideo auth status
# 2. 列出可用数字人和声音
npx framevideo chanjing people list --json
npx framevideo chanjing voices list --json
# 3. 创建数字人视频项目
# (详见 references/website-project-payload.md)
# 4. 下载生成的视频
# 下载到 assets/digital-humans/
场景 2: 下载平台音乐
# 1. 认证
npx framevideo auth login
# 2. 浏览音乐分类
npx framevideo chanjing music categories --json
# 3. 列出音乐
npx framevideo chanjing music list --category <id> --compact
# 4. 下载
npx framevideo chanjing music download --id <id> --output assets/music/bg.mp3
场景 3: AI Creation 生图/生视频
# 使用 AI Creation API 生成图片或视频
# (详见 references/ai-creation.md)
Routing
Read only what the request needs:
| User intent | Read |
|---|---|
| Auth status, login, missing credentials, Studio login routes | studio-routes.md |
| Select/list public or custom digital humans or voices | studio-routes.md |
| Generate digital-human presenter video | website-project-payload.md, then api-enums.md |
| Poll digital-human task status or interpret status codes | api-enums.md |
| Generate Chanjing AI image/video assets | ai-creation.md |
| Wire generated presenter, AI B-roll, images, captions, or local assets into FrameVideo | composition-wiring.md |
| Download Chanjing BGM or SFX | studio-routes.md, section “Background music and sound effects” |
Use Shot plans from framevideo-ai-production for real AIGC generation |
ai-creation.md plus framevideo-ai-production/references/chanjing-aigc-handoff.md |
For local-only Kokoro TTS, Whisper transcription, or background removal, use framevideo-media instead.
Platform Rules
- Use OAuth Bearer tokens from the shared Chanjing credential store. Never print, echo, save, or commit tokens.
- Prefer the existing FrameVideo CLI, Studio routes, and
ChanjingOpenApiClientinpackages/cli/src/tts/chanjingOpenapi.ts; do not copy standalone credential scripts. - Do not use
app_id,secret_key,CHANJING_OPENAPI_ACCESS_TOKEN, ordp_open_appdata for agent-authored workflows. - If OAuth is missing and preview/Studio is available, prefer the Studio login UX instead of stopping at env-var instructions.
- Download every generated or selected platform asset before referencing it in composition HTML. Do not use render-time remote Chanjing/OSS URLs.
Asset Locations
Use these local project paths:
| Asset | Local directory |
|---|---|
| Digital-human videos | assets/digital-humans/ |
| AI Creation images | assets/ai-creation/images/ |
| AI Creation videos | assets/ai-creation/videos/ |
| Chanjing background music | assets/music/ |
| Chanjing sound effects | assets/sfx/ |
Digital-Human Workflow
- Check auth. If missing, use Studio login flow from studio-routes.md.
- Resolve
person_idandvoice_id. - Fetch the selected person's real metadata before layout.
- Build a website-project payload from website-project-payload.md.
- Save the website project and verify
project_id. - Submit video synthesis and verify
task_id. - Poll using api-enums.md.
- Download the finished video to
assets/digital-humans/. - Wire it into FrameVideo using composition-wiring.md.
ID Sources
| Who picks | person_id |
voice_id |
|---|---|---|
| User provides explicit ids | Use the provided id, but fetch matching person metadata before layout | Use directly |
| Agent selects | Must come from current Studio/CLI Chanjing list routes after OAuth | Must come from current Chanjing voice list routes, or selected public person's audioManId |
Do not invent ids or reuse fixture ids. If a user-provided person id cannot be fetched, report that error instead of falling back to another person.
AI Creation Workflow
Use this for non-presenter AIGC images/videos such as B-roll, generated backgrounds, concept images, product display clips, transition clips, or abstract visuals.
- Read ai-creation.md.
- Fetch active models with
framevideo chanjing ai-models ...; do not read backend constants or copied model lists. - Build payloads from the selected model's
params_config.fields; do not hard-code model options. - Create
.framevideo/ai-creation-tasks/*.jsontask metadata before submission. - Apply local and remote idempotency checks before submitting billable tasks.
- Submit only missing tasks.
- Use short sync runs to poll/download.
- Compose only with local files under
assets/ai-creation/images/orassets/ai-creation/videos/.
Music and SFX Workflow
Use Chanjing platform music/SFX when the user asks for platform BGM, soundtrack, chorus extraction, whooshes, hits, clicks, or transition sounds.
npx framevideo chanjing music categories --json
npx framevideo chanjing music list --compact
npx framevideo chanjing music download --id <music-id> --chorus --duration 10 --json
npx framevideo chanjing sound-effect list --compact
npx framevideo chanjing sfx download --id <effect-id> --volume 0.8 --json
Keep BGM under assets/music/ and SFX under assets/sfx/. Use low BGM volume under speech or digital-human narration.
Composition Wiring
Read composition-wiring.md before writing HTML that uses Chanjing assets.
Core rules:
- Visual video clips are muted.
- Add a separate
<audio>clip when the generated video contains narration. - Keep captions clear of faces, hands, presenter body, CTA, product UI, and platform subtitles.
- For styled FrameVideo captions, prefer synthesis timing fields when available; otherwise use
framevideo-mediato transcribe the downloaded local video/audio. - For transparent presenter overlays, use
framevideo-mediaremove-background after download.
Hard Stops
- Do not pass a digital-human id as a website
projectId. - Do not hand-author
workspace_v2. - Do not call compatibility stubs such as direct digital-human generation routes that return 501.
- Do not insert remote
output_urlor Chanjing/OSS URLs into composition HTML. - Do not create duplicate AI Creation tasks when matching local or recent remote task metadata exists.
Validation
After wiring Chanjing assets into a FrameVideo project:
npx framevideo lint
npx framevideo validate
npx framevideo inspect
For visual overlap, caption safety, presenter placement, and B-roll readability, use framevideo-visual-qa.