Features
LLM inferencing with GPT-compatible API
Image generation via Stable Diffusion backends
Audio-to-text using Whisper
Video generation from text prompts
Vision/image understanding (LLaVA, etc.)
Autonomous agents without coding (LocalAGI)
Semantic search and memory (LocalRecall)
OpenAI-compatible function calling
Realtime low-latency voice over WebSocket
Constrained grammar output control
GPU acceleration with CUDA, OpenCL, Vulkan
P2P federated inference for distributed models
Model Context Protocol (MCP) support
Voice activity detection and speaker diarization
Chat with 600+ AI models (GPT-5.5, Claude Opus 4.8, Gemini 3.5 Flash, Grok 4.3)
Image generation (Nano Banana Pro, GPT-5 Image, FLUX.2 Pro, Seedream 4.5)
Video generation (Sora 2, Veo 3.1, Seedance 2.0, Kling 2.6, PixVerse 5.5)
Web search with citations (Sonar Pro)
Upload and chat with any file (no size limit)
Custom AI agents and assistants for workflows
Prompt library and builder for reusable prompts
Voice chat (dictation and text-to-speech)
Multi-model side-by-side comparison
Model fallback (automatic provider switching)
Usage dashboard for tracking consumption
Projects – organize chats with file sources and instructions
OpenAI-compatible API for external tools
MCP integrations (8000+ tools including Gmail, Slack)
Kimi K2.7 Code model for coding tasks (since June 2026)
