Features
OpenAI-compatible chat completions API
Text generation with automatic crawling of linked content
Image analysis and vision (multimodal)
Speech-to-text (8x cheaper than Google Cloud)
Text-to-speech with Kokoro TTS integration
Unified embeddings for text, images, and code
Prebuilt tools: Domain Name Generator, AI Text Editor, Prompt Optimizer, Image Captioning
Self-hosting option for full data control
Sub-second response times
Privacy-first: no unnecessary data retention
Streaming support for chat completions
Summarization API with max length parameter
Audio-in audio-out via Gemma 4 Multimodal Audio API
Qwen3.5-4B with reasoning and thinking support
Fine-tune open-source LLMs (Llama 3, Mistral, Llama 2)
Automated hyperparameter optimization (Ludwig)
One-click deployment with autoscaling
Low-latency inference endpoints
Model evaluation and version comparison
Custom training data from S3/GCS
LoRA/QLoRA adapter-based fine-tuning
Per-request monitoring and logging
VPC deployment for data privacy
Support for multiple model architectures
