Features
Real-time test run streaming
Centralized Playwright test reporting with multi-tab run reports
AI-powered failure classification and automatic error grouping
Flaky test detection with stability percentages and root cause categories
Built-in Trace Viewer for step-by-step execution review
Test evidence: failure screenshots, full execution video, retry artifacts
Rerun only failed tests with shard and branch awareness
Istanbul-based code coverage with automatic shard merging
Environment mapping via regex branch patterns
Test case management with suites, custom fields, bulk operations
Bug report auto-fill to Jira, Linear, Asana, Monday.com
Scheduled PDF reports with executive summaries
MCP server for AI agent querying of test results
PR status checks with pass rate and flaky thresholds
CI/CD integrations: GitHub Actions, GitLab CI, Azure DevOps, TeamCity
Full trace logging for every agent step
30+ LLM-as-a-judge metrics including hallucination detection
Test Suites for simplified pass/fail evaluation
Ollie auto-fix coding agent that writes fixes to git
Opik Agent Playground for rapid agent prototyping
Cost intelligence for Claude Code and Codex spend
Human annotation and debugging of individual traces
Production monitoring for agents
Experiment management with custom visualizations
Model versioning and dataset management
@track decorator for easy integration with any LLM framework
Self-hosted or cloud deployment
Real-time trace streaming and visualization
Supports OpenAI, LangChain, LlamaIndex, Claude Code, Codex
Integration with PyTorch, TensorFlow, Hugging Face, and more
