Features
Real-time end-to-end spoken dialogue
Personalized voice cloning from short audio samples
Open-source model weights available on GitHub
Low-latency inference (<200ms per turn)
Multi-turn conversation memory
Emotion and tone control in generated speech
Speaker diarization for multi-party conversations
Customizable voice characteristics (pitch, speed, cadence)
On-premise deployment option
RESTful and WebSocket API support
Python SDK for easy integration
Pre-trained base model with support for English
Ultra-realistic text-to-speech with expressive controls (sarcasm, whisper, giggle)
Voice cloning from audio samples or text prompts
10,000+ voices across 70+ languages
Music v2 generation from text prompts, up to 320kbps output
Sound effects and ambient audio generation from prompt or library
Scribe v2 speech-to-text with 98% accuracy and speaker diarization
Dubbing v2 for voice translation with watermark options
ElevenAgents: omnichannel conversational agents via voice, chat, email, WhatsApp
Low-latency models: Eleven Flash ~75ms, Eleven Turbo v2.5
Guardrails and workflows for agent deployment
Analytics and A/B testing for conversational agents
Image and video generation (Veo, Sora, Wan, Kling, Seedance)
Ads Engine for AI-powered ad production in ElevenCreative
Flows Agent for automated creative workflows
SynthID watermarking for AI-generated audio detection
