# Speech Recognition Systems

> Use when building speech recognition and ASR systems.

- Skill: `loopyluci/speech-recognition-systems` (Agent Skill)
- Install (CLI): `npx skillmds@latest add loopyluci/speech-recognition-systems`
- Raw SKILL.md: https://api.skillmd.com/api/skills/loopyluci/speech-recognition-systems/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- License: MIT
- Author: LoopyLuci (https://skillmd.com/u/loopyluci)
- Updated: 2026-09-08
- Page: https://skillmd.com/skills/loopyluci/speech-recognition-systems

---


# Speech Recognition Systems

Building automatic speech recognition (ASR) systems — from acoustic models and feature extraction through end-to-end models (Whisper, wav2vec), language models, and deployment.

## When to Use

- Transcribing audio to text
- Building voice-controlled applications
- Implementing real-time captioning
- Custom ASR for domain-specific vocabulary

## ASR Pipeline

```python
ASR_APPROACHES = {
    'classical': 'Acoustic model → Language model → Decoder (WFST) — Kaldi, DeepSpeech',
    'end_to_end': 'Whisper, wav2vec 2.0 — single neural net, audio → text',
    'ctc': 'Connectionist Temporal Classification — frame-level alignment, no segment boundaries',
    'transducer': 'RNN-T — streaming-friendly, used in mobile ASR',
}

class ASRPipeline:
    def __init__(self, model_name: str = 'openai/whisper-small'):
        from transformers import pipeline
        self.asr = pipeline('automatic-speech-recognition', model=model_name)
    
    def transcribe(self, audio_path: str, language: str = 'en') -> Dict:
        result = self.asr(audio_path, generate_kwargs={'language': language})
        return {'text': result['text'], 'confidence': result.get('confidence', 0)}
```

## Verification Checklist

- [ ] ASR approach selected (end-to-end, CTC, transducer)
- [ ] Model handles target languages and accents
- [ ] Real-time streaming (if needed) with low latency
- [ ] Custom vocabulary/phrase boosting for domain terms
- [ ] Word-level timestamps for alignment
- [ ] Noise robustness tested (background, multiple speakers)