# Genai Vision

> Integrating Stable Diffusion for vision generation and Whisper for audio/multimodal tasks.

- Skill: `j4flmao/genai-vision` (Agent Skill)
- Install (CLI): `npx skillmds@latest add j4flmao/genai-vision`
- Raw SKILL.md: https://api.skillmd.com/api/skills/j4flmao/genai-vision/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: j4flmao (https://skillmd.com/u/j4flmao)
- Updated: 2026-09-21
- Page: https://skillmd.com/skills/j4flmao/genai-vision

---


# GenAI Vision & Multimodal

## Integration Strategy
- **Stable Diffusion**: Use Diffusers library for image generation. Optimize with xformers.
- **Whisper**: Process audio locally or via API for high-accuracy transcription to complement visual tasks.

## Multimodal Workflow
```mermaid
%%{init: {"theme": "default", "flowchart": {"useMaxWidth": true}}}%%
graph TD
    A[User Audio] --> B(Whisper)
    B -->|Text Prompt| C[Stable Diffusion]
    C --> D[Generated Image]
```

## Stable Diffusion Snippet
```python
import torch
from diffusers import StableDiffusionPipeline

def generate_image(prompt: str, output_path: str):
    pipe = StableDiffusionPipeline.from_pretrained(
        "runwayml/stable-diffusion-v1-5", 
        torch_dtype=torch.float16
    ).to("cuda")
    pipe.enable_xformers_memory_efficient_attention()
    
    image = pipe(prompt, num_inference_steps=30).images[0]
    image.save(output_path)
```