Features
Single API key for 300+ AI models
OpenAI-compatible endpoint — drop-in replacement
Intelligent cost-optimized routing across models
Automatic fallback to alternative models on failure
Response caching to reduce latency and cost
Per-request rate limiting and throttling
Usage analytics with cost breakdown per model
Custom model selection rules and priorities
Real-time model benchmarking
Vision model support (Gemini 2.5, GPT-4.1, Qwen3 VL)
Pay provider cost + fixed per-request fee
Load balancing across providers
Detailed logging and observability
API access only (no visual interface)
Supports models from OpenAI, Anthropic, Google, Meta, Mistral, Cohere, AI21, Together, Groq
Command generative model: agentic, multimodal, 49 languages
North Mini Code open-source agentic coding model
Transcribe speech-to-text in 14 languages
Embed multimodal text representations for RAG
Rerank relevance boosting for search quality
Model Vault dedicated secure inference per instance
Private deployment in VPC, on-premises, or Model Vault
North enterprise AI workplace platform with agents
Compass intelligent search and discovery system
LLM serving fairness to prevent noisy neighbor effects
Customization via fine-tuning on proprietary data
Multi-layered security and industry certifications
API access with trial and production keys
Agentic tool orchestration and reasoning
Integration with Wiz for security incident automation via MCP
