Features
Full trace logging for every agent step
30+ LLM-as-a-judge metrics including hallucination detection
Test Suites for simplified pass/fail evaluation
Ollie auto-fix coding agent that writes fixes to git
Opik Agent Playground for rapid agent prototyping
Cost intelligence for Claude Code and Codex spend
Human annotation and debugging of individual traces
Production monitoring for agents
Experiment management with custom visualizations
Model versioning and dataset management
@track decorator for easy integration with any LLM framework
Self-hosted or cloud deployment
Real-time trace streaming and visualization
Supports OpenAI, LangChain, LlamaIndex, Claude Code, Codex
Integration with PyTorch, TensorFlow, Hugging Face, and more
Distributed tracing for LLM agents
Capture prompts, retrievals, tool calls, outputs
Human annotations on traces
Create datasets from traces
Run experiments to compare changes
OpenTelemetry-native instrumentation
Self-host locally, Docker, or Kubernetes
Cloud instances with free tier
Vendor agnostic: any model or framework
3M+ monthly downloads, 9k+ GitHub stars