domitriusclark Video Analysis
Extract frames from a video, then read them for visual analysis.
Prerequisites
Requires ffmpeg and yt-dlp (for URLs). Verify before starting:
command -v ffmpeg && command -v yt-dlp
Install if missing: brew install yt-dlp ffmpeg
Extract Frames
Run the bundled script:
scripts/extract_frames.sh <url_or_path> [output_dir] [--start HH:MM:SS] [--end HH:MM:SS] [--rate N]
The script auto-selects an appropriate frame rate based on video duration (targeting 60-200 frames). Override with --rate.
| Video Length | Auto Rate | Approx Frames |
|---|---|---|
| < 1 min | 1 fps | ~60 |
| 1-5 min | 0.5 fps | ~75-150 |
| 5-15 min | 0.2 fps | ~60-180 |
| 15-60 min | 0.1 fps | ~90-360 |
| 60+ min | 0.033 fps | ~120+ |
Analyze
Read extracted frame images with the Read tool. Strategy:
- Sample frames spread across the video for an overview (e.g., every 10th frame)
- Focus on sections of interest at higher density
- Map frame number to timestamp:
frame_NNNN.jpg→(NNNN - 1) / rateseconds
For long videos (60+ min), extract specific segments with --start/--end rather than the full video.
Clean Up
Confirm with the user, then remove the output directory.