Video Translation
Translates video content to another language using AI voice cloning, lip sync, and subtitle translation.
When to Use
Use this skill when:
- Translating video content to another language
- Creating dubbed versions of videos
- Adding translated voiceover
- Localizing video for different markets
- Converting Chinese videos to English (or vice versa)
Features
- AI Voice Cloning: Preserves original speaker's voice characteristics
- Emotion Preservation: Maintains emotional tone in translated audio
- Lip Sync: Adjusts lip movements to match translated audio
- Subtitle Translation: Automatically translates hardcoded subtitles
Workflow
Step 1: Get Source Video
Obtain the video URL that needs translation.
Step 2: Submit Translation Task
Call submitAideoTask with:
- prompt: Specify target language and translation requirements
- multiInputs: Array containing source video URL
Step 3: Poll for Results
- First check: Wait 210 seconds after submission
- Subsequent checks: Wait 30 seconds between polls
- Call
getAideoTaskStatusto check progress
Step 4: Timeout Handling
Maximum wait time: 20 minutes
If task exceeds 20 minutes, report as timeout failure.
Step 5: Return Results
On completion, return the translated video URL.
Examples
Example 1: Chinese to English
User request: "Translate this Chinese video to English"
submitAideoTask:
prompt: "Translate this Chinese video to English, including subtitle translation and voice dubbing with emotion preservation"
multiInputs: ["chinese_video.mp4"]
Example 2: English to Japanese
User request: "Create a Japanese version of this video"
submitAideoTask:
prompt: "Translate this English video to Japanese with natural voice cloning and lip sync"
multiInputs: ["english_video.mp4"]
Example 3: Multi-language Localization
User request: "I need this video in Spanish"
submitAideoTask:
prompt: "Translate this video to Spanish with dubbed audio and translated subtitles"
multiInputs: ["source_video.mp4"]
Supported Languages
- Chinese (Mandarin)
- English
- Japanese
- Korean
- Spanish
- And more...
Important Notes
- Processing time varies based on video length
- Voice cloning quality depends on source audio quality
- Maximum wait time is 20 minutes
- Works best with clear audio and minimal background noise