Features
Automatic LLM tracing via OpenTelemetry
Built-in evaluations: faithfulness, relevance, safety
Custom evaluator training with annotation
Real-time monitoring dashboard
Evaluation dashboard with test runs
CI/CD integration for automated evaluation
Prompt management and registry
LLM hub proxy for smart routing
Granular latency and token usage tracking
Cost attribution per user or feature
On-prem and air-gapped deployment
SOC 2 and HIPAA compliance
One-line code setup for tracing
Supports Python, TypeScript, Go, Ruby
Support for 20+ LLM providers
Distributed tracing for LLM agents
Capture prompts, retrievals, tool calls, outputs
Human annotations on traces
Create datasets from traces
Run experiments to compare changes
OpenTelemetry-native instrumentation
Self-host locally, Docker, or Kubernetes
Cloud instances with free tier
Vendor agnostic: any model or framework
3M+ monthly downloads, 9k+ GitHub stars
