Features
Single API key for 300+ AI models
OpenAI-compatible endpoint — drop-in replacement
Intelligent cost-optimized routing across models
Automatic fallback to alternative models on failure
Response caching to reduce latency and cost
Per-request rate limiting and throttling
Usage analytics with cost breakdown per model
Custom model selection rules and priorities
Real-time model benchmarking
Vision model support (Gemini 2.5, GPT-4.1, Qwen3 VL)
Pay provider cost + fixed per-request fee
Load balancing across providers
Detailed logging and observability
API access only (no visual interface)
Supports models from OpenAI, Anthropic, Google, Meta, Mistral, Cohere, AI21, Together, Groq
Local model execution for offline inference
Connect online APIs: OpenAI (ChatGPT), Anthropic (Claude), Google (Gemini), Meta (Llama), Mistral AI, Alibaba (Qwen),
123+ HuggingFace models available
Memory feature (coming soon) for context persistence
Minimalist UI with dark mode
Open source under MIT license on GitHub
Cross-platform desktop app (Mac, Windows, Linux)
Version 0.8.3 with bug fixes and performance improvements
