Alternatives to Braintrust

Raindrop traces, detects, and simulates fixes for silent AI agent failures in production before they reach your users.

TruLens traces AI agent runs with OpenTelemetry-native evals, showing where an agent fails and where you can cut cost.

Athina is a shared workspace where your team writes prompts, runs evals, annotates datasets, and traces LLM calls in production.

Langfuse Prompt Experiments runs prompt tests and evals against real production traces, with versioned prompts and one-click rollback.

Galileo runs your pre-launch evals as live guardrails, scoring 100% of agent traffic with distilled Luna models.

Agent evaluation platform that simulates voice and chat agents, traces production, and scores hallucinations before your customers hit them

Galileo is an AI observability and eval engineering platform that turns offline evals into production guardrails for agents and RAG.

Voice AI QA and evals: simulate callers before launch, then score every production call on 500+ audio-native metrics.

Open-source LLM observability, prompt management, and agent evals on one data model.

Comet's Opik turns LLM traces into grouped root causes, eval scores and proposed code fixes

LLM evaluation, observability, and red teaming in one workspace for teams shipping production AI

Comet's open-source platform for tracing AI agents, running LLM-as-a-judge evals, and auditing coding-agent spend.

Trace, replay and debug AI agent runs — LLM calls, tool use and multi-agent interactions in one timeline, via a single SDK

QuickCompare replays your production LLM traffic on candidate models so you see which behaviours change before you switch.

Laminar is open-source agent observability that auto-captures every LLM and tool call and flags agent failures you never wrote a detector

Metoro is a Kubernetes observability and AI SRE agent that watches your cluster with eBPF and opens fix PRs for production issues.

Burntop now ships as a full-stack FastAPI, React 19 and Postgres template that keeps coding agents honest with 200+ end-to-end tests.

OpenJudge is an Apache 2.0 open-source AI evaluation framework shipping 50+ benchmark-validated graders for agents, LLMs, code, math, and multimodal models.

LangSmith is agent and LLM observability: trace, monitor, and evaluate AI agents in cloud, BYOC, or self-hosted.

Open-source LLM observability and agent evaluation you can trace, score, and self-host on your own infrastructure.

Dash0 is OpenTelemetry-native observability with Agent0 doing autonomous root cause analysis and fix PRs.

Open-source LLM observability and agent evaluation you can trace, self-host, and eval end to end.

Silico is Goodfire's mechanistic interpretability agent for understanding, debugging, and steering the internals of your AI models.

Open source AI engineering platform for agent and LLM tracing, evaluation, prompt management, and ML lifecycle work.

Fiddler AI is an enterprise control plane for agent observability, inline guardrails, and auditable AI governance.

Maxim AI simulates, evaluates and observes AI agents — plus Bifrost, its Apache 2.0 LLM gateway for routing, budgets and guardrails.

Honeycomb Query Assistant turns plain-English questions into HQL against live production telemetry.

Weights & Biases tracks ML experiments, versions models and datasets, and traces LLM apps — now inside CoreWeave Forge

PostHog is your product's context layer: analytics, replays, errors, logs, and business data in one warehouse you and your AI agents can query.

Open-source Python library that turns vibe checks into reproducible evaluation loops for RAG pipelines and AI agents.