Voice AI Engine Development

Voice AI Engine Development

Build real-time conversational AI voice engines using async worker pipelines, streaming transcription, LLM agents, and TTS synthesis with interrupt handling and multi-provider support

When to Use

• The request matches the skill description: Build real-time conversational AI voice engines using async worker pipelines, streaming transcription, LLM agents, and TTS synthesis with interrupt handling and multi-provider support
• The task needs the implementation patterns, examples, validation checks, or edge cases listed in the topic map.
• The work would benefit from the complete guidance preserved in references/full-guidance.md.

Core Workflow

1. Confirm the request matches this skill's trigger, scope, and risk profile.
2. Use the topic map to identify the relevant pattern, checklist, or example before writing detailed guidance or code.
3. Load references/full-guidance.md when implementation details, examples, anti-patterns, validation checks, or edge cases are needed.
4. Apply only the relevant guidance instead of loading or repeating the entire reference by default.
5. Verify the result against any validation checks, limitations, security notes, or platform constraints in the reference.

Topic Map

• Overview
• When to Use This Skill
• Core Architecture Principles
• The Worker Pipeline Pattern
• Base Worker Pattern
• Component Implementation Guide
• Transcriber (Audio → Text)
• Agent (Text → Response)
• Synthesizer (Text → Audio)
• Output Device (Audio → Client)
• The Interrupt System
• How Interrupts Work
• InterruptibleEvent Pattern
• Multi-Provider Factory Pattern
• WebSocket Integration
• Common Pitfalls and Solutions
• Audio Jumping/Cutting Off
• Echo/Feedback Loop

Reference Map

• references/full-guidance.md preserves the complete original guidance, including examples and detailed edge cases.

Limitations

• Use this skill only when the task clearly matches the scope described above.
• Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
• Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.

Progressive Loading

Keep this SKILL.md as the compact routing and workflow entrypoint. Load the reference file only when the user task requires the deeper implementation material.