transcribe — local speech to text, GPU first
Any ffmpeg-decodable file becomes <name>.txt ([MM:SS] (lang) text), <name>.srt, and on request
<name>.words.json with per-word timings, the input a video edit needs. Audio never leaves the
machine; the only network step is a one-time model download.
Pick the engine
| Machine |
Script |
Why |
| Apple Silicon |
scripts/transcribe_mlx.py |
large-v3 on the GPU. Measured: 2 min of a noisy prize announcement in 16 s, where medium on CPU returned fragments; a 38-min talk in 8.7 min (4x realtime) |
| NVIDIA / Linux, or speaker labels needed |
scripts/transcribe.py |
faster-whisper (CTranslate2): CUDA yes, Metal no, so on a Mac it is CPU-only however fast the Mac |
uv run scripts/transcribe_mlx.py rec.m4a # → rec.txt, rec.srt
uv run scripts/transcribe_mlx.py clip.mp4 --words # + rec.words.json for editing
uv run scripts/transcribe_mlx.py call.m4a --languages en ru # languages that can occur
uv run scripts/transcribe.py rec.m4a --model large-v3 # CPU/CUDA path
uv run scripts/transcribe.py call.m4a --multilingual # per-segment language on that path
uv run --with pyannote.audio scripts/transcribe.py talk.wav --diarize --speakers Alice Bob
Both scripts declare their dependencies in a PEP 723 header, so uv run needs no venv. Diarization
needs HUGGINGFACE_TOKEN with the pyannote model terms accepted; without it the transcript comes back
unlabelled, and the script says so.
Long files (10+ min): run in the background and wait for ✅ done.
Gotchas
- Whisper picks one language from the first 30 s and applies it to the whole file. A call that
opens in English and moves to Russian comes out as fluent, confident English, or the second
language simply vanishes (measured: a Russian+English file detected as
ru returned only the
Russian words). transcribe_mlx.py splits on silences (Silero VAD) and detects per chunk; on the
CPU path pass --multilingual.
- A chunk detected as a language not in
--languages (Russian read as Ukrainian, a laugh as
Welsh) is re-run in the first non-English listed language instead of keeping the guess.
- Accented English is detected as the speaker's native language and comes back translated. A
Russian speaker asking a question in English at a talk, with
--languages ru en, returned a fluent
Russian sentence the speaker never said. For a recording known to be one language, force it
(--languages en) and keep the multi-language run only where the language really switches.
- A quiet distant voice can vanish under the VAD. At a panel filmed from the audience, a speaker
~9 dB below the person next to the camera (−31 vs −22.5 dB mean) lost two minutes of her answer:
the transcript jumps from 02:53 to 04:26 with no gap marker. Check long gaps in the timestamps; a
second recording (a laptop transcriber in the room) or a normalised re-run fills them.
- Crowd noise hallucinates. 25 minutes of a bar came back as
lang=fr with 454 invented
sentences. Treat such a file as no speech; if one voice in it matters, re-run with the language
forced.
- Unknown names become celebrities. Keep a glossary per project (people, places, products) and
fix the transcript once, before anything quotes it.
- Screen recordings on macOS often have no audio track.
ffprobe first.
- Parakeet: check the version. v2 (
parakeet-tdt-0.6b-v2) is English-only and turns other
languages into confident English nonsense. v3 (parakeet-tdt-0.6b-v3) covers 25 European
languages, Russian among them, but not Bashkir or Tatar (keep Whisper for those). v3 runs wherever
ONNX Runtime does, CPU included: onnx-asr in Python (onnx_asr.load_model("nemo-parakeet-tdt-0.6b-v3")),
parakeet-rs in Rust (supervox). The scripts in this skill do not drive it yet.
Finding recordings on a Mac
- Zoom:
~/Documents/Zoom/<date time …>/audioNNN.m4a (folder name = start, file mtime ≈ end).
- Voice Memos: names and files are in
~/Library/Group Containers/group.com.apple.VoiceMemos.shared/Recordings/CloudRecordings.db
(ZCLOUDRECORDING: ZCUSTOMLABEL, ZPATH, ZDATE + 978307200 = unix start, ZDURATION).
- Long video on a slow card: pull only the audio,
ffmpeg -i in.mp4 -vn -c:a copy out.m4a.
Privacy
Write transcripts where the task lives, never into an unrelated repo. Personal recordings belong in
the user's own private store, not next to project code.
1---2name: solo-transcribe3description: Transcribe audio or video to text locally — on the Apple GPU with mlx-whisper large-v3, or faster-whisper on CPU/CUDA — with the language decided per stretch of speech, .srt subtitles, word timings for editing, and optional speaker labels. Nothing is uploaded. Use when user says "расшифруй", "транскрибируй", "transcribe this", "make a transcript", "субтитры из видео", "что там говорят в записи", or hands a recording, a call, a voice memo or a folder of clips that needs its speech as text. Do NOT use for listening to a live room (use /supervox) or for cutting the footage itself (use /video-edit).4license: MIT5metadata:6 source: https://skillmd.com/skills/fortunto2/solo-transcribe7 author: fortunto28 version: "1.0.1"9 openclaw:10 emoji: "🎙️"11---1213# transcribe — local speech to text, GPU first1415Any ffmpeg-decodable file becomes `<name>.txt` (`[MM:SS] (lang) text`), `<name>.srt`, and on request16`<name>.words.json` with per-word timings, the input a video edit needs. Audio never leaves the17machine; the only network step is a one-time model download.1819## Pick the engine2021| Machine | Script | Why |22|---|---|---|23| Apple Silicon | `scripts/transcribe_mlx.py` | large-v3 on the GPU. Measured: 2 min of a noisy prize announcement in 16 s, where `medium` on CPU returned fragments; a 38-min talk in 8.7 min (4x realtime) |24| NVIDIA / Linux, or speaker labels needed | `scripts/transcribe.py` | faster-whisper (CTranslate2): CUDA yes, **Metal no**, so on a Mac it is CPU-only however fast the Mac |2526```bash27uv run scripts/transcribe_mlx.py rec.m4a # → rec.txt, rec.srt28uv run scripts/transcribe_mlx.py clip.mp4 --words # + rec.words.json for editing29uv run scripts/transcribe_mlx.py call.m4a --languages en ru # languages that can occur30uv run scripts/transcribe.py rec.m4a --model large-v3 # CPU/CUDA path31uv run scripts/transcribe.py call.m4a --multilingual # per-segment language on that path32uv run --with pyannote.audio scripts/transcribe.py talk.wav --diarize --speakers Alice Bob33```3435Both scripts declare their dependencies in a PEP 723 header, so `uv run` needs no venv. Diarization36needs `HUGGINGFACE_TOKEN` with the pyannote model terms accepted; without it the transcript comes back37unlabelled, and the script says so.3839Long files (10+ min): run in the background and wait for `✅ done`.4041## Gotchas4243- **Whisper picks one language from the first 30 s and applies it to the whole file.** A call that44 opens in English and moves to Russian comes out as fluent, confident English, or the second45 language simply vanishes (measured: a Russian+English file detected as `ru` returned only the46 Russian words). `transcribe_mlx.py` splits on silences (Silero VAD) and detects per chunk; on the47 CPU path pass `--multilingual`.48- **A chunk detected as a language not in `--languages`** (Russian read as Ukrainian, a laugh as49 Welsh) is re-run in the first non-English listed language instead of keeping the guess.50- **Accented English is detected as the speaker's native language and comes back translated.** A51 Russian speaker asking a question in English at a talk, with `--languages ru en`, returned a fluent52 Russian sentence the speaker never said. For a recording known to be one language, force it53 (`--languages en`) and keep the multi-language run only where the language really switches.54- **A quiet distant voice can vanish under the VAD.** At a panel filmed from the audience, a speaker55 ~9 dB below the person next to the camera (−31 vs −22.5 dB mean) lost two minutes of her answer:56 the transcript jumps from 02:53 to 04:26 with no gap marker. Check long gaps in the timestamps; a57 second recording (a laptop transcriber in the room) or a normalised re-run fills them.58- **Crowd noise hallucinates.** 25 minutes of a bar came back as `lang=fr` with 454 invented59 sentences. Treat such a file as no speech; if one voice in it matters, re-run with the language60 forced.61- **Unknown names become celebrities.** Keep a glossary per project (people, places, products) and62 fix the transcript once, before anything quotes it.63- **Screen recordings on macOS often have no audio track.** `ffprobe` first.64- **Parakeet: check the version.** v2 (`parakeet-tdt-0.6b-v2`) is English-only and turns other65 languages into confident English nonsense. v3 (`parakeet-tdt-0.6b-v3`) covers 25 European66 languages, Russian among them, but not Bashkir or Tatar (keep Whisper for those). v3 runs wherever67 ONNX Runtime does, CPU included: `onnx-asr` in Python (`onnx_asr.load_model("nemo-parakeet-tdt-0.6b-v3")`),68 `parakeet-rs` in Rust (supervox). The scripts in this skill do not drive it yet.6970## Finding recordings on a Mac7172- Zoom: `~/Documents/Zoom/<date time …>/audioNNN.m4a` (folder name = start, file mtime ≈ end).73- Voice Memos: names and files are in74 `~/Library/Group Containers/group.com.apple.VoiceMemos.shared/Recordings/CloudRecordings.db`75 (`ZCLOUDRECORDING`: `ZCUSTOMLABEL`, `ZPATH`, `ZDATE` + 978307200 = unix start, `ZDURATION`).76- Long video on a slow card: pull only the audio, `ffmpeg -i in.mp4 -vn -c:a copy out.m4a`.7778## Privacy7980Write transcripts where the task lives, never into an unrelated repo. Personal recordings belong in81the user's own private store, not next to project code.