Ck:ai Multimodal

AI Multimodal

Process audio, images, videos, documents using Gemini. Generate images, videos, speech, music via Gemini + MiniMax.

Setup

# Google Gemini (analysis + image/video gen)
export GEMINI_API_KEY="your-key"  # https://aistudio.google.com/apikey
# MiniMax (image/video/speech/music gen)
export MINIMAX_API_KEY="your-key"  # https://platform.minimax.io/user-center/basic-information/interface-key
pip install google-genai python-dotenv pillow requests

API Key Rotation (Optional)

For high-volume Gemini usage, configure multiple keys:

export GEMINI_API_KEY="key1"
export GEMINI_API_KEY_2="key2"  # auto-rotates on rate limit

Quick Start

Verify setup: python scripts/check_setup.py Analyze media: python scripts/gemini_batch_process.py --files <file> --task <analyze|transcribe|extract>

• TIP: When you're asked to analyze an image, check if gemini command is available, then use echo "<prompt to analyze image>" | gemini -y -m <gemini.model> command (read model from $HOME/.opencode/.ck.json: gemini.model). If gemini command is not available, use python scripts/gemini_batch_process.py --files <file> --task analyze command. Generate (Gemini): python scripts/gemini_batch_process.py --task <generate|generate-video> --prompt "desc" Generate (MiniMax): python scripts/minimax_cli.py --task <generate|generate-video|generate-speech|generate-music> --prompt "desc"

Stdin support: Pipe files via stdin for Gemini analysis (auto-detects PNG/JPG/PDF/WAV/MP3).

Models

Google Gemini / Imagen

• Image gen: gemini-3.1-flash-image-preview (Nano Banana 2 - DEFAULT), gemini-2.5-flash-image (Flash), gemini-3-pro-image-preview (Pro 4K), imagen-4.0-generate-001 (standard), imagen-4.0-ultra-generate-001 (quality), imagen-4.0-fast-generate-001 (speed)
• Video gen: veo-3.1-generate-preview (8s clips with audio)
• Analysis: gemini-2.5-flash (recommended), gemini-2.5-pro (advanced)

MiniMax (NEW)

• Image gen: image-01 (standard), image-01-live (enhanced) - $0.03/image, 1-9 batch
• Video gen (Hailuo): MiniMax-Hailuo-2.3 (1080p), MiniMax-Hailuo-2.3-Fast (50% cheaper), MiniMax-Hailuo-02 (first+last frame), S2V-01 (subject ref)
• Speech/TTS: speech-2.8-hd (best), speech-2.8-turbo (fast) - 300+ voices, 40+ languages, emotion control
• Music: music-2.5 - 4-minute songs with vocals, synchronized lyrics

Scripts

• gemini_batch_process.py: Gemini CLI for transcribe|analyze|extract|generate|generate-video. Auto-resolves API keys, Imagen 4 + Veo + Nano Banana workflows.
• minimax_cli.py: MiniMax CLI for generate|generate-video|generate-speech|generate-music. Supports all MiniMax models.
• minimax_generate.py: MiniMax generation functions (image, video, speech, music). Library for programmatic use.
• minimax_api_client.py: MiniMax HTTP client, auth, async polling, file download utilities.
• media_optimizer.py: ffmpeg/Pillow preflight: compress/resize/convert media to stay within API limits.
• document_converter.py: Gemini-powered PDF/image/Office → markdown converter.
• check_setup.py: Setup checker for API keys and dependencies.

Use --help for options.

References

Load for detailed guidance:

Limits

Formats: Audio (WAV/MP3/AAC, 9.5h), Images (PNG/JPEG/WEBP, 3.6k), Video (MP4/MOV, 6h), PDF (1k pages) Size: 20MB inline, 2GB File API Important:

• If you are going to generate a transcript of the audio, and the audio length is longer than 15 minutes, the transcript often gets truncated due to output token limits in the Gemini API response. To get the full transcript, you need to split the audio into smaller chunks (max 15 minutes per chunk) and transcribe each segment for a complete transcript.
• If you are going to generate a transcript of the video and the video length is longer than 15 minutes, use ffmpeg to extract the audio from the video, truncate the audio to 15 minutes, transcribe all audio segments, and then combine the transcripts into a single transcript. Transcription Output Requirements:
• Format: Markdown
• Metadata: Duration, file size, generated date, description, file name, topics covered, etc.
• Parts: from-to (e.g., 00:00-00:15), audio chunk name, transcript, status, etc.
• Transcript format:

  [HH:MM:SS -> HH:MM:SS] transcript content
  [HH:MM:SS -> HH:MM:SS] transcript content
  ...
  

Outputs

IMPORTANT: Invoke "/ck:project-organization" skill to organize the outputs.

Resources

• Gemini API Docs
• Gemini Pricing
• MiniMax API Docs
• MiniMax Pricing