Sora Video Generation
Generate videos using OpenAI's Sora API.
API Reference
Endpoint: POST https://api.openai.com/v1/videos
Parameters
| Parameter |
Values |
Description |
prompt |
string |
Text description of the video (required) |
input_reference |
file |
Optional image that guides generation |
model |
sora-2, sora-2-pro |
Model to use (default: sora-2) |
seconds |
4, 8, 12 |
Video duration (default: 4) |
size |
720x1280, 1280x720, 1024x1792, 1792x1024 |
Output resolution |
Important Notes
- Image dimensions must match video size exactly - the script auto-resizes
- Video generation takes 1-3 minutes typically
- Videos expire after ~1 hour - download immediately
Usage
# Basic text-to-video
uv run ~/.clawdbot/skills/sora/scripts/generate_video.py \
--prompt "A cat playing piano" \
--filename "output.mp4"
# Image-to-video (auto-resizes image)
uv run ~/.clawdbot/skills/sora/scripts/generate_video.py \
--prompt "Slow dolly shot, steam rising, warm lighting" \
--filename "output.mp4" \
--input-image "reference.png" \
--seconds 8 \
--size 720x1280
# With specific model
uv run ~/.clawdbot/skills/sora/scripts/generate_video.py \
--prompt "Cinematic scene" \
--filename "output.mp4" \
--model sora-2-pro \
--seconds 12
Script Parameters
| Flag |
Description |
Default |
--prompt, -p |
Video description (required) |
- |
--filename, -f |
Output file path (required) |
- |
--input-image, -i |
Reference image path |
None |
--seconds, -s |
Duration: 4, 8, or 12 |
8 |
--size, -sz |
Resolution |
720x1280 |
--model, -m |
sora-2 or sora-2-pro |
sora-2 |
--api-key, -k |
OpenAI API key |
env var |
--poll-interval |
Check status every N seconds |
10 |
API Key
Set OPENAI_API_KEY environment variable or pass --api-key.
Prompt Engineering for Video
Good prompts include:
- Camera movement: dolly, pan, zoom, tracking shot
- Motion description: swirling, rising, falling, shifting
- Lighting: golden hour, candlelight, dramatic rim lighting
- Atmosphere: steam, particles, bokeh, haze
- Mood/style: cinematic, commercial, lifestyle, editorial
Example prompts:
Food commercial:
Slow dolly shot of gourmet dish, soft morning sunlight streaming through window,
subtle steam rising, warm cozy atmosphere, premium food commercial aesthetic
Lifestyle:
Golden hour light slowly shifting across mountains, gentle breeze rustling leaves,
serene morning atmosphere, premium lifestyle commercial
Product shot:
Cinematic close-up, dramatic lighting with warm highlights,
slow reveal, luxury commercial style
Workflow: Image → Video
- Generate image with Nano Banana Pro (or use existing)
- Pass image as
--input-image to Sora
- Write prompt describing desired motion/atmosphere
- Script auto-resizes image to match video dimensions
Output
- Videos saved as MP4
- Typical file size: 1.5-3MB for 8 seconds
- Resolution matches
--size parameter
1---2name: sora3description: Generate videos from text prompts or reference images using OpenAI Sora. ✅ USE WHEN: - Need AI-generated video from text description - Want image-to-video (animate a still image) - Creating cinematic/artistic video content - Need motion/animation without lip-sync ❌ DON'T USE WHEN: - Need lip-sync (person speaking) → use veed-ugc or ugc-manual - Just need image generation → use nano-banana-pro or morpheus - Editing existing videos → use Remotion - Need UGC-style talking head → use veed-ugc INPUT: Text prompt + optional reference image OUTPUT: MP4 video (various resolutions/durations)4---5
6# Sora Video Generation
7
8Generate videos using OpenAI's Sora API.
9
10## API Reference
11
12**Endpoint:** `POST https://api.openai.com/v1/videos`
13
14### Parameters
15
16| Parameter | Values | Description |
17|-----------|--------|-------------|
18| `prompt` | string | Text description of the video (required) |
19| `input_reference` | file | Optional image that guides generation |
20| `model` | `sora-2`, `sora-2-pro` | Model to use (default: sora-2) |
21| `seconds` | `4`, `8`, `12` | Video duration (default: 4) |
22| `size` | `720x1280`, `1280x720`, `1024x1792`, `1792x1024` | Output resolution |
23
24### Important Notes
25
26- **Image dimensions must match video size exactly** - the script auto-resizes
27- Video generation takes 1-3 minutes typically
28- Videos expire after ~1 hour - download immediately
29
30## Usage
31
32```bash
33# Basic text-to-video
34uv run ~/.clawdbot/skills/sora/scripts/generate_video.py \
35 --prompt "A cat playing piano" \
36 --filename "output.mp4"
37
38# Image-to-video (auto-resizes image)
39uv run ~/.clawdbot/skills/sora/scripts/generate_video.py \
40 --prompt "Slow dolly shot, steam rising, warm lighting" \
41 --filename "output.mp4" \
42 --input-image "reference.png" \
43 --seconds 8 \
44 --size 720x1280
45
46# With specific model
47uv run ~/.clawdbot/skills/sora/scripts/generate_video.py \
48 --prompt "Cinematic scene" \
49 --filename "output.mp4" \
50 --model sora-2-pro \
51 --seconds 12
52```
53
54## Script Parameters
55
56| Flag | Description | Default |
57|------|-------------|---------|
58| `--prompt`, `-p` | Video description (required) | - |
59| `--filename`, `-f` | Output file path (required) | - |
60| `--input-image`, `-i` | Reference image path | None |
61| `--seconds`, `-s` | Duration: 4, 8, or 12 | 8 |
62| `--size`, `-sz` | Resolution | 720x1280 |
63| `--model`, `-m` | sora-2 or sora-2-pro | sora-2 |
64| `--api-key`, `-k` | OpenAI API key | env var |
65| `--poll-interval` | Check status every N seconds | 10 |
66
67## API Key
68
69Set `OPENAI_API_KEY` environment variable or pass `--api-key`.
70
71## Prompt Engineering for Video
72
73### Good prompts include:
74
751. **Camera movement**: dolly, pan, zoom, tracking shot
762. **Motion description**: swirling, rising, falling, shifting
773. **Lighting**: golden hour, candlelight, dramatic rim lighting
784. **Atmosphere**: steam, particles, bokeh, haze
795. **Mood/style**: cinematic, commercial, lifestyle, editorial
80
81### Example prompts:
82
83**Food commercial:**
84```
85Slow dolly shot of gourmet dish, soft morning sunlight streaming through window,
86subtle steam rising, warm cozy atmosphere, premium food commercial aesthetic
87```
88
89**Lifestyle:**
90```
91Golden hour light slowly shifting across mountains, gentle breeze rustling leaves,
92serene morning atmosphere, premium lifestyle commercial
93```
94
95**Product shot:**
96```
97Cinematic close-up, dramatic lighting with warm highlights,
98slow reveal, luxury commercial style
99```
100
101## Workflow: Image → Video
102
1031. Generate image with Nano Banana Pro (or use existing)
1042. Pass image as `--input-image` to Sora
1053. Write prompt describing desired motion/atmosphere
1064. Script auto-resizes image to match video dimensions
107
108## Output
109
110- Videos saved as MP4
111- Typical file size: 1.5-3MB for 8 seconds
112- Resolution matches `--size` parameter