Alternatives to TruLens

Open source LLM observability with OpenTelemetry tracing, evals, and prompt management for agents

Open-source Python library that turns vibe checks into reproducible evaluation loops for RAG pipelines and AI agents.

OpenTelemetry-native LLM tracing, evals, prompt management and GPU monitoring you can self-host free under Apache 2.0.

Open-source LLM observability and agent evals: trace, evaluate, and improve AI agents on one MIT-licensed platform

Open-source AI evaluation and observability for LLMs, RAG apps, AI agents, and ML models.

OpenJudge is an Apache 2.0 open-source AI evaluation framework shipping 50+ benchmark-validated graders for agents, LLMs, code, math, and multimodal models.

LLM evaluation and observability that turns production traces into repeatable evals and CI regression tests

Open-source agent frameworks (langchain, langgraph, deepagents) plus LangSmith for tracing, evals, deployment and governance.

Braintrust delivers agent observability with evals, pattern discovery, and trace-scale storage in one platform.

Galileo turns pre-launch AI evals into production guardrails that block bad agent and RAG responses at runtime.

Athina is a shared workspace where your team writes prompts, runs evals, annotates datasets, and traces LLM calls in production.

Conan is a native macOS HUD for Claude Code that streams every prompt, tool call, skill and token live as the session runs.

Chronicle Labs replays your production data to test and validate AI agents before launch.

Edgee Team gives engineering leaders per-repo, per-PR token observability and spending caps for coding agents.

Local token usage and cost tracking for 21 AI coding agents — reads the logs they already write.

Weights & Biases tracks ML experiments, versions models and datasets, and traces LLM apps — now inside CoreWeave Forge

Agnost AI monitors production AI agents, clusters silent failures, and opens a fix for review.

Agent monitoring and evals that surface recurring failures, search any pattern, and test fixes offline before you ship.

Sharbo is a skill network for AI agents — encode expert workflows once, let every agent activate them autonomously.

Nebuly turns the conversations employees and customers have with your AI agents into adoption, fluency and ROI numbers for enterprise leaders.

Observability and optimization for OpenClaw agents — trace failures, attribute cost, and ask Tracy what to fix.

Claw Lens is a zero-config local observability dashboard for OpenClaw AI agents — live monitor, cost analytics, and security audit in one

Open-source LLM observability and agent evaluation you can trace, self-host, and eval end to end.

Open-source LLMOps platform for tracing, agent simulations, evaluations and an AI gateway, from your own agents to the coding agents your engineers run.

Comet's Opik turns LLM observability and evaluation into agent code fixes, not just trace dashboards

Maxim AI pairs AI agent evaluation, simulation and observability with Bifrost, an open-source LLM gateway.

Helicone is an AI gateway and LLM observability platform that routes, logs, and caches traffic across 100+ model providers.

Multi-model AI verification: three frontier models answer blind, cross-examine each other, and return the one answer that survived with a

NannyML estimates your ML model's live performance without ground-truth labels and alerts you only when it actually matters

Fiddler AI is an AI agent observability and control plane with inline guardrails, continuous evaluation, and auditable governance.