Features
Run 1000+ local LLMs offline
One-click model download from Hugging Face
Built-in TurboQuant (8x faster inference, 6x less memory)
Chat with persistent memory across sessions
Project organization for context switching
OpenAI-compatible local API endpoint for agents
Document chat (RAG) support
Code review and refactoring
Private document analysis
GGUF, MLX, ONNX model format support
No account or sign-up required
Open-source under Apache-2.0
Available on macOS, Windows, Linux, iOS, Android
Supports agents: Hermes, OpenClaw, Cline
TurboQuant: zero accuracy loss at 3 bits
Local model execution for offline inference
Connect online APIs: OpenAI (ChatGPT), Anthropic (Claude), Google (Gemini), Meta (Llama), Mistral AI, Alibaba (Qwen),
123+ HuggingFace models available
Memory feature (coming soon) for context persistence
Minimalist UI with dark mode
Open source under MIT license on GitHub
Cross-platform desktop app (Mac, Windows, Linux)
Version 0.8.3 with bug fixes and performance improvements