ElevenLabs Voice Cloning
Use this skill for voice cloning, text-to-speech, preview generation, and voice asset management. Treat voice samples and cloned voices as sensitive biometric data.
Core Workflow
- Confirm the user has explicit rights and consent to upload, clone, synthesize, and retain the voice.
- Keep ElevenLabs API keys server-side. Use a backend proxy or service for cloning, synthesis, previews, and voice management.
- Validate audio before upload or processing: type, size, duration, sample rate, loudness, speech presence, and tenant quota.
- Store source audio and generated speech in private storage with signed URLs, retention windows, and tenant isolation.
- Create a durable
voice_jobs record for clone and long synthesis requests; process through workers or queues.
- Use idempotency keys for clone requests, preview generation, and synthesis retries.
- Store provider voice IDs, consent record IDs, input checksums, model/settings versions, and deletion state.
- Redact transcript text and file names from logs when they may contain personal data.
Brazilian Portuguese Defaults
Use these as starting values, then tune with real samples:
const voiceSettings = {
stability: 0.35,
similarity_boost: 1.0,
style: 0.0,
use_speaker_boost: true
};
Prefer 2 to 5 minutes of clean, natural speech with varied intonation. Reject samples with background music, other speakers, clipping, or unclear rights.
Consent and Safety
- Store consent actor, voice owner, allowed use, retention period, revocation path, source file checksum, and timestamp.
- Require a deletion workflow that removes local assets and provider-side voices when consent is revoked or retention expires.
- Add human review before publishing cloned voice output for customer-facing or paid workflows.
- Do not expose provider voice IDs in a way that allows cross-tenant access.
Verification
- Test clone success, invalid audio, missing consent, duplicate retry, synthesis timeout, provider failure, deletion, and signed URL expiry.
- Confirm browser bundles do not contain ElevenLabs secrets.
- Confirm revoked consent blocks queued synthesis and triggers cleanup.
Related Skills
skill-ai-orchestrationskill-manual-video-processingskill-live-processing
1---2name: skill-elevenlabs-voice-cloning-23description: Use for ElevenLabs voice generation and voice cloning integrations, including Brazilian Portuguese TTS, explicit voice consent, server-side API keys, secure audio uploads, asynchronous jobs, validation, retryable synthesis, and safe handling of biometric voice data.4---56# ElevenLabs Voice Cloning78Use this skill for voice cloning, text-to-speech, preview generation, and voice asset management. Treat voice samples and cloned voices as sensitive biometric data.910## Core Workflow11121. Confirm the user has explicit rights and consent to upload, clone, synthesize, and retain the voice.132. Keep ElevenLabs API keys server-side. Use a backend proxy or service for cloning, synthesis, previews, and voice management.143. Validate audio before upload or processing: type, size, duration, sample rate, loudness, speech presence, and tenant quota.154. Store source audio and generated speech in private storage with signed URLs, retention windows, and tenant isolation.165. Create a durable `voice_jobs` record for clone and long synthesis requests; process through workers or queues.176. Use idempotency keys for clone requests, preview generation, and synthesis retries.187. Store provider voice IDs, consent record IDs, input checksums, model/settings versions, and deletion state.198. Redact transcript text and file names from logs when they may contain personal data.2021## Brazilian Portuguese Defaults2223Use these as starting values, then tune with real samples:2425```typescript26const voiceSettings = {27 stability: 0.35,28 similarity_boost: 1.0,29 style: 0.0,30 use_speaker_boost: true31};32```3334Prefer 2 to 5 minutes of clean, natural speech with varied intonation. Reject samples with background music, other speakers, clipping, or unclear rights.3536## Consent and Safety3738- Store consent actor, voice owner, allowed use, retention period, revocation path, source file checksum, and timestamp.39- Require a deletion workflow that removes local assets and provider-side voices when consent is revoked or retention expires.40- Add human review before publishing cloned voice output for customer-facing or paid workflows.41- Do not expose provider voice IDs in a way that allows cross-tenant access.4243## Verification4445- Test clone success, invalid audio, missing consent, duplicate retry, synthesis timeout, provider failure, deletion, and signed URL expiry.46- Confirm browser bundles do not contain ElevenLabs secrets.47- Confirm revoked consent blocks queued synthesis and triggers cleanup.4849## Related Skills5051- `skill-ai-orchestration`52- `skill-manual-video-processing`53- `skill-live-processing`54
IAPro-Community