Features
Adaptive routing with online learning from real traffic
Automatic failover under 50ms across 200+ models
Zero token markup – pass-through billing at provider rates
Per-workspace routing objective: cheapest, quality, balanced, adaptive
Full structured logs for cost, model, latency, and failure reasons
Guardrails and agent firewall with PII shield and content policies
OpenAI-compatible endpoint – drop-in replacement
OrcaRouter MCP server for agent framework integration
Prompt versioning with A/B splits and one-click rollback
Prompt caching across 5-minute and 1-hour windows
RouterArena-leading accuracy at 75.5% (June 2026)
Routing DSL for custom model composition (new June 2026)
Model fusion for combining model outputs (new June 2026)
Compliance enforcement and audit reporting (Team and up)
Risk-scored agent firewall with anomaly detection
Command generative model: agentic, multimodal, 49 languages
North Mini Code open-source agentic coding model
Transcribe speech-to-text in 14 languages
Embed multimodal text representations for RAG
Rerank relevance boosting for search quality
Model Vault dedicated secure inference per instance
Private deployment in VPC, on-premises, or Model Vault
North enterprise AI workplace platform with agents
Compass intelligent search and discovery system
LLM serving fairness to prevent noisy neighbor effects
Customization via fine-tuning on proprietary data
Multi-layered security and industry certifications
API access with trial and production keys
Agentic tool orchestration and reasoning
Integration with Wiz for security incident automation via MCP
