Features
Real-time cost monitoring
Multi-provider aggregation (OpenAI, Anthropic, etc.)
Custom budget alerts (email, Slack)
Historical usage analytics
API for programmatic access
Weekly/monthly report generation
Usage forecast and anomaly detection
Full trace logging for every agent step
30+ LLM-as-a-judge metrics including hallucination detection
Test Suites for simplified pass/fail evaluation
Ollie auto-fix coding agent that writes fixes to git
Opik Agent Playground for rapid agent prototyping
Cost intelligence for Claude Code and Codex spend
Human annotation and debugging of individual traces
Production monitoring for agents
Experiment management with custom visualizations
Model versioning and dataset management
@track decorator for easy integration with any LLM framework
Self-hosted or cloud deployment
Real-time trace streaming and visualization
Supports OpenAI, LangChain, LlamaIndex, Claude Code, Codex
Integration with PyTorch, TensorFlow, Hugging Face, and more
