Features
OpenAI-compatible endpoint
Real-time provider benchmarking (price, latency, load)
Automatic cheapest/fastest routing
Support for closed and open LLMs
Restrict routing to specific providers
Performance constraint configuration
List all available models & family models
MakeHub Tools Layer for custom tooling
Direct integration with Cline and Roo Code forks
Local model execution for offline inference
Connect online APIs: OpenAI (ChatGPT), Anthropic (Claude), Google (Gemini), Meta (Llama), Mistral AI, Alibaba (Qwen),
123+ HuggingFace models available
Memory feature (coming soon) for context persistence
Minimalist UI with dark mode
Open source under MIT license on GitHub
Cross-platform desktop app (Mac, Windows, Linux)
Version 0.8.3 with bug fixes and performance improvements
