Features
Real-time speech-to-speech translation in 60+ languages
Automatic voice cloning preserving original speaker's voice
Pre-recorded voice library selection
Automatic language detection
Custom glossaries for domain-specific vocabulary
Noise suppression and music isolation
Live captions and transcripts
Streaming API with WebRTC/WebSocket
ASR, translation, and TTS in one pipeline
Emotion transfer (coming soon)
Sub-second latency (<1 sec)
Private server deployment option
RTMP/SRT/HLS streaming integration
Ultra-realistic text-to-speech with expressive controls (sarcasm, whisper, giggle)
Voice cloning from audio samples or text prompts
10,000+ voices across 70+ languages
Music v2 generation from text prompts, up to 320kbps output
Sound effects and ambient audio generation from prompt or library
Scribe v2 speech-to-text with 98% accuracy and speaker diarization
Dubbing v2 for voice translation with watermark options
ElevenAgents: omnichannel conversational agents via voice, chat, email, WhatsApp
Low-latency models: Eleven Flash ~75ms, Eleven Turbo v2.5
Guardrails and workflows for agent deployment
Analytics and A/B testing for conversational agents
Image and video generation (Veo, Sora, Wan, Kling, Seedance)
Ads Engine for AI-powered ad production in ElevenCreative
Flows Agent for automated creative workflows
SynthID watermarking for AI-generated audio detection
