Video Analysis
Analyzes video content for understanding and extracts highlight clips using AI multimodal analysis.
When to Use
Use this skill when:
- Analyzing video content for summary
- Extracting highlight/exciting moments
- Generating video keywords and tags
- Creating trailers from longer videos
- Understanding plot and storyline
- Finding viral-worthy moments
Analysis Capabilities
- Visual Analysis: Scene detection, object recognition, action identification
- Audio Analysis: Speech recognition, music detection, sound effects
- Language Understanding: Dialogue analysis, sentiment detection
- Multimodal Fusion: Combines all modalities for comprehensive understanding
Workflow
Step 1: Get Source Video
Obtain the video URL to analyze.
Step 2: Submit Analysis Task
Call submitAideoTask with appropriate prompt:
- For understanding: "Analyze and summarize this video"
- For highlights: "Extract the most exciting moments"
Step 3: Poll for Results
- First check: Wait 210 seconds after submission
- Subsequent checks: Wait 30 seconds between polls
- Call
getAideoTaskStatusto check progress
Step 4: Timeout Handling
Maximum wait time: 20 minutes
If task exceeds 20 minutes, report as timeout failure.
Step 5: Return Results
Results vary by task type:
- Understanding: Summary, keywords, plot analysis (JSON)
- Highlights: Array of highlight clip URLs
Examples
Example 1: Extract Highlights
User request: "Create a 30-second highlight reel from this video"
submitAideoTask:
prompt: "Extract the most exciting moments from this video to create a 30-second highlight compilation"
multiInputs: ["source_video.mp4"]
Example 2: Video Understanding
User request: "Analyze this video and give me a summary"
submitAideoTask:
prompt: "Analyze this video content and generate: summary, keywords, and plot analysis"
multiInputs: ["video.mp4"]
Example 3: Create Trailer
User request: "Make a trailer from this long video"
submitAideoTask:
prompt: "Extract the most engaging and exciting moments to create a compelling trailer"
multiInputs: ["long_video.mp4"]
Example 4: Find Viral Moments
User request: "Find the best clips for social media"
submitAideoTask:
prompt: "Identify and extract the most viral-worthy moments from this video for social media"
multiInputs: ["content_video.mp4"]
Output Types
Highlight Extraction
- Returns array of clip URLs
- Each clip contains exciting/engaging moment
- Clips can be used directly or further edited
Video Understanding
- Summary: Brief description of video content
- Keywords: Relevant tags and topics
- Plot Analysis: Story structure and key events
Important Notes
- Maximum video length: 2 hours
- Maximum wait time: 20 minutes
- Highlight extraction returns multiple clip URLs
- Understanding returns JSON with summary, keywords, plot
- Processing time: ~10 minutes per 1-minute video