Alternatives to TruLens

OpenLIT is an open-source, OpenTelemetry-native platform for LLM tracing, evaluation, and prompt management.

Open-source tracing, evaluation, and prompt iteration for AI agents — self-host it on your own infrastructure with no per-span bill.

Open-source LLM observability, prompt management, and evaluation for teams running AI agents in production.

MLflow is the open source AI engineering platform for agent and LLM observability, evaluation, and prompt management.

Open-source framework to replace vibe checks with reproducible, LLM-driven evaluation loops for RAG and agents.

Open-source AI evaluation and observability for LLMs, RAG, agents, and predictive ML models.

Open-source AI observability for agent tracing, LLM-as-a-judge evals, and coding agent cost tracking

OpenJudge is an open-source AI evaluation framework with 50+ production-grade graders for agents, multimodal models, code, and math.

Open-source LLM observability and evals that trace every agent step so you can ship reliable AI agents.

OpenTelemetry-native observability with an AI SRE that investigates incidents and opens fix PRs.

Open-source OpenTelemetry observability for Python LLM apps

Open-source workspace for building, evaluating, and deploying AI agents you talk to in Slack, Telegram, or a browser chat

Open-source LLM observability, prompt management, and agent evals in one MIT-licensed platform.

Open-source AI agent observability that catches failures automatically and helps you fix them.

LangSmith is an AI agent observability platform for tracing, monitoring, and evaluating LLM apps and long-running agents.

Discontinued: WhyLabs ceased operations in 2025 and open-sourced its platform; whylogs and langkit live on as open source.

Open-source LLM observability and evaluation for agentic AI, with real-time tracing, cost optimization, and auto-fix.

OpenCompass (司南) benchmarks LLMs, VLMs, and AI4S models with 100+ open evaluation datasets

Raindrop is agent observability that finds silent failures in production AI agents, investigates the root cause, and simulates the fix before you merge.

Free open-source AI usage tracking & analytics for developers

QA and evals platform for voice AI agents, scoring calls on 500+ audio-native metrics.

Silico is Goodfire's interpretability agent for understanding, debugging, and controlling the internals of your AI models

AI observability and evals that turn agent traces into git-committed code fixes

Enterprise LLM evaluation, observability, and AI red teaming that standardizes quality across every team.

Track, forecast, and optimize AI spend across OpenAI, Google AI, Azure, and Bedrock.

Collaborative LLM development platform for prompt management, evaluation, and production monitoring

Fiddler AI is an enterprise AI control plane for agent observability, guardrails, and governance across the agentic lifecycle.

Maxim AI simulates, evaluates, and observes AI agents so teams can ship reliable agents 5x faster.

AI observability platform that turns offline evals into production guardrails for AI agents and RAG systems.

Neptune.ai is real-time experiment tracking for frontier AI training teams — now owned by OpenAI