Alternatives to Langfuse Prompt Experiments

Athina AI is a collaborative AI development platform for managing prompts, running LLM evaluations, and monitoring production traces in one

Chronicle Labs replays your production data to test and validate AI agents before launch.

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

Open source AI engineering platform for agent and LLM tracing, evaluation, prompt management, and ML lifecycle work.

Honeycomb Query Assistant turns plain-English questions into HQL against live production telemetry.

Open-source LLM observability and agent evals: trace, evaluate, and improve production AI agents with MIT-licensed tooling.

Galileo AI Evals turns offline evaluations into production guardrails that gate your AI agents in real time.

Weights & Biases tracks ML experiments and traces LLM apps so teams ship AI models faster

Evidently AI is an open-source Python framework for LLM evaluation, RAG testing, and ML model monitoring under Apache 2.0.

Galileo is an AI observability and eval engineering platform that turns offline evals into production guardrails for agents and RAG.

Open-source AI observability for agent tracing, LLM-as-a-judge evals, and coding-agent cost tracking.

Braintrust is an agent observability platform that traces AI runs, scores quality with evals, and surfaces production failure patterns.

OpenCompass (司南) benchmarks LLMs, VLMs, and AI4S models on 100+ open evaluation datasets with dated leaderboards

Raindrop traces, detects, and simulates fixes for silent AI agent failures in production before they reach your users.

Replay your production LLM traffic on candidate models to see which behaviours change before you switch.

Metoro is a Kubernetes observability and AI SRE agent that watches your cluster with eBPF and opens fix PRs for production issues.

Free open-source AI usage tracking and analytics that syncs your token and cost data from Claude, Cursor, ChatGPT and other tools onto a shareable dashboard.

OpenLIT is an open-source, OpenTelemetry-native agent harness engineering platform for LLM tracing, evals, and guardrails you self-host.

Voice AI QA and evals: simulate callers before launch, then score every production call on 500+ audio-native metrics.

Arize Phoenix is open-source LLM observability: trace agent steps, run evals, and self-host your traces.

Dash0 is OpenTelemetry-native observability where Agent0 investigates incidents, finds root cause, and opens fix PRs.

Open-source LLM observability and agent evaluation you can trace, evaluate, and self-host for free.

Silico is Goodfire's interpretability agent for understanding and debugging the internals of your AI models.

LangSmith is agent and LLM observability: trace, monitor, and evaluate AI agents in cloud, BYOC, or self-hosted.

Opik by Comet turns LLM traces into root-cause groupings, eval scores and code fixes so agent teams stop shipping the same bug twice

LLM evaluation, observability, and red teaming in one workspace — ship AI you can actually trust

TruLens traces AI agent runs with OpenTelemetry-native evals, showing where an agent fails and where you can cut cost.

ToolSpend tracks AI API spend across OpenAI, Anthropic, Google AI, Bedrock and Azure in one live cost dashboard.

Fiddler AI is an enterprise AI control plane for agent observability, inline guardrails, and auditable AI governance.

Open-source AI coworker workspace that builds, schedules and ships agents to Slack or Telegram