Features
Pre-converted .aimodel files for 30+ models
End-to-end conversion scripts with gotcha documentation
Custom Metal kernels for GPU/ANE acceleration
Swift runner (CoreAIKit) for one-line model loading
iOS 27 and macOS 27 Core AI compatibility
Verified on iPhone 17 Pro GPU/ANE
MoE and dense model support
MLA (GLM-4.7-Flash) support
Official-QAT int4 quantization (Gemma 4)
Vision-language models (Qwen3-VL, Holo2-4B, MiniCPM-V 4.6)
Audio understanding (Qwen2.5-Omni-3B) and ASR (Whisper, Qwen3-ASR, Parakeet-TDT)
Text-to-speech (Kokoro-82M, VoxCPM)
Diffusion LLM (LLaDA-8B) and ternary VLA (BitVLA)
Embedding and reranker models for RAG
Object detection models (not explicitly listed but implied by 'detection')
One-command install on macOS, Linux, Windows
Run hundreds of open models locally
MLX engine for Apple Silicon (faster, less memory)
GGUF model support via llama.cpp (Ollama 0.30)
NVIDIA Nemotron 3 Ultra for high-throughput reasoning
Cloud scaling with Free, Pro, Max tiers
Run multiple cloud models in parallel (1, 3, 10)
Web-enabled cloud agents for real-time info retrieval
Fully offline operation for mission-critical work
Data never used for training; privacy-first design
CLI tool with model management and configuration
REST API for building AI applications
Upload and share private models (Pro and above)
40,000+ community integrations
Desktop app for macOS, Linux, Windows
