Features
Automatic LLM tracing via OpenTelemetry
Built-in evaluations: faithfulness, relevance, safety
Custom evaluator training with annotation
Real-time monitoring dashboard
Evaluation dashboard with test runs
CI/CD integration for automated evaluation
Prompt management and registry
LLM hub proxy for smart routing
Granular latency and token usage tracking
Cost attribution per user or feature
On-prem and air-gapped deployment
SOC 2 and HIPAA compliance
One-line code setup for tracing
Supports Python, TypeScript, Go, Ruby
Support for 20+ LLM providers
Trace agent executions step by step
Monitor real-time dashboards with cost tracking
Online LLM-as-judge evals for quality scoring
Automated insights with unsupervised topic clustering
SmithDB purpose-built for agent traces
Sub-second query performance across millions of traces
Full-text search with inverted index
JSON key-path filtering and trajectory queries
Self-host SmithDB inside your VPC
LangSmith Engine for autonomous issue detection and fixes
Deploy and scale agents with LangSmith Deployment
Sandboxes for safe agent-generated code execution
Fleet agents for no-code agent creation
Supports Python, TypeScript, Go, Java SDKs
