Alternatives to Roark

Agent observability that traces every AI run, scores quality with evals, and surfaces production patterns you didn't know to look for.

Arize Phoenix is open-source LLM observability: trace every agent step, run evals, and self-host your traces.

AI observability and eval-engineering platform that turns offline evals into live production guardrails.

AI observability and eval engineering platform that turns offline evals into live production guardrails for agents and RAG systems.

Raindrop is agent observability that catches silent AI agent failures in production, traces the root cause, and simulates the fix in CI.

Open-source, OpenTelemetry-native observability for AI agents that catches failures automatically and helps you fix them.

RapidSOS pipes AI-assisted emergency intelligence and pre-call device data straight into 911 dispatch.

OpenTelemetry-native observability with an AI SRE that investigates incidents and opens fix PRs.

Agent and LLM observability from the LangChain team: trace, monitor, and evaluate agents in production, cloud, BYOC, or self-hosted.

Open-source LLM observability, prompt management, and evaluation for teams running AI agents in production.

Open-source, OpenTelemetry-native evaluation and tracing that shows exactly where your AI agent fails — and where you can cut cost.

Collaborative AI development platform for prompt management, dataset evaluation, and production LLM monitoring.

Maxim AI simulates, evaluates, and observes AI agents in one workspace, with an open-source gateway (Bifrost) for routing and governance.

Level AI scores 100% of your contact-center interactions with CX-specific AI models, not a sampled QA review.

Open-source agent tracing, LLM-as-a-judge evals, and coding-agent cost tracking you can self-host.

Sierra builds and runs conversational AI agents that resolve customer conversations across chat, voice, SMS, email, and WhatsApp.

TruEra brings ML monitoring, testing, and AI quality management into Snowflake for production model observability.

Five9 Genius AI bundles contact center AI — AI Agents, Agent Assist, Summaries, Insights and GenAI Studio — natively into the Five9 Intelligent CX Platform.

Open-source LLM observability, prompt management, and agent evals in one MIT-licensed platform.

Replay your live LLM traffic on candidate models to see exactly what behaviour changes before you switch.

Metoro is a Kubernetes-native observability platform whose eBPF collector feeds an AI SRE agent that detects, root-causes, and opens fix pull requests for

Open-source, OpenTelemetry-native platform for LLM tracing, evaluation, prompt management, guardrails, and GPU monitoring you host yourself.

OpenJudge is an open-source AI evaluation framework with 50+ production-grade graders for agents, multimodal models, code, and math.

OpenIntake answers every law firm lead by phone, text, chat, or form 24/7 — a fully managed AI intake service built only for law firms.

AI care coordinators that call patients, book visits, and close care gaps inside your existing EHR and portals.

Trace, evaluate, and iterate AI agents with Phoenix — open-source LLM observability you can self-host.

Silico is Goodfire's interpretability agent for understanding, debugging, and controlling the internals of your AI models

Opik, Comet's open-source LLM observability and eval platform, turns agent traces into root-cause groupings and git-committed code fixes

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

Eval, tracing, red teaming, and governance for teams that need AI quality standardized across products.