Speech & Audio Agent Skills

Run state-of-the-art machine learning models directly in JavaScript/TypeScript across browsers and server-side runtimes using Transformers.js.

Generate AI-powered podcast-style audio narratives from text using Azure OpenAI's GPT Realtime Mini model via WebSocket, with full-stack implementation from React frontend to Python FastAPI backend.

Integrate with Azure AI services including Search, Speech, OpenAI, and Document Intelligence for search, transcription, OCR, and text-to-speech tasks.

Integrate real-time bidirectional voice conversations with AI assistants using the Azure AI VoiceLive SDK for Java, including WebSocket streaming, turn detection, and voice configuration.

Build real-time voice AI applications using the Azure AI Voice Live SDK for bidirectional WebSocket audio communication.

Integrate Azure OpenAI and OpenAI services in .NET applications for chat completions, embeddings, image generation, audio transcription, and assistants.

Build real-time voice AI applications with bidirectional WebSocket communication using the Azure AI Voice Live SDK for .NET.

Transcribe audio to text using Azure AI Transcription SDK with real-time and batch support, including timestamps and diarization.

Build real-time voice AI applications with bidirectional WebSocket communication using the Azure AI Voice Live SDK for JavaScript/TypeScript.

Transcribe short audio files (up to 60 seconds) using Azure Speech-to-Text REST API with Python, without requiring the Speech SDK.

Build server-side call automation workflows with Azure Communication Services Call Automation Java SDK, including IVR systems, call routing, recording, DTMF recognition, text-to-speech, and AI-powered call flows.

Routes NVIDIA Nemotron Speech (Riva) NIM tasks for ASR, TTS, and NMT, covering cloud-hosted inference, self-hosted Docker deployment, and custom model builds.

Score a clinical ASR manifest against a chosen NIM, produce a five-section KER leaderboard, and route the user via a post-eval decision tree.

Generate images, videos, and audio using fal.ai models via MCP tools, with support for text-to-image, text/image-to-video, text-to-speech, and video-to-audio.

Build real-time voice and multimodal AI applications using Pipecat and Daily, covering pipeline architecture, AI service integration, and transport options.

Ingest, index, search, and edit video and audio from files, URLs, live streams, or desktop sessions with timestamps, subtitles, overlays, and real-time alerts.

Convert text to speech and speech to text using fal.ai audio models.

Generate spoken audio for narration, voiceovers, IVR prompts, and accessibility reads using the OpenAI Audio API with bundled CLI and built-in voices.

Transcribe audio files to text with optional speaker diarization and known-speaker hints using OpenAI models.

Build real-time, bidirectional streaming applications with the Gemini Live API, covering WebSocket-based audio/video/text streaming, voice activity detection, function calling, session management, and ephemeral tokens.

Generate music from text prompts using ElevenLabs Music API, supporting instrumental tracks, songs with lyrics, composition plans, video-to-music, and inpainting.

Generate sound effects from text descriptions using ElevenLabs, with support for looping, duration control, and prompt influence tuning.

Transform the voice in an audio recording into a different target voice while preserving emotion, timing, and delivery using the ElevenLabs Voice Changer API.

Transcribe audio to text using ElevenLabs Scribe v2, supporting 90+ languages, speaker diarization, and word-level timestamps.

Generate natural speech from text using ElevenLabs voice AI, supporting 70+ languages, multiple models, and various output formats.

Analyzes music listening data from Apple Music or Spotify exports to build a taste profile, then generates personalized playlists with AI-generated songs and album covers.

Generate text, images, video, speech, and music via the MiniMax AI platform from the terminal.

Automate Aivoov text-to-speech and voiceover operations through Composio's Aivoov toolkit via Rube MCP.

Automate Gladia speech-to-text and audio processing tasks through Composio's Gladia toolkit via Rube MCP.

Automate Rev AI speech-to-text operations through Composio's Rev AI toolkit via Rube MCP.

Automate Deepgram speech-to-text and audio processing tasks through Composio's Deepgram toolkit via Rube MCP.

Automate AI inference, chat completions, audio translation, and TTS voice management through GroqCloud's high-performance API via Composio.

Automate ElevenLabs text-to-speech workflows: generate speech from text, browse and inspect voices, check subscription limits, list models, stream audio, and retrieve history via the Composio MCP integration.

Automate Castingwords transcription and captioning tasks through Composio's toolkit via Rube MCP.

Extracts YouTube video transcripts and metadata (title, publisher, likes) via the BrowserAct API without CAPTCHA or IP restrictions.

Run 250+ AI apps from the command line: generate images and videos, call LLMs, search the web, create 3D models, and automate Twitter posts.