Alternatives to RAGAS

LangSmith is agent and LLM observability from the LangChain team: trace, monitor, evaluate, and deploy AI agents.

Open-source AI evaluation and observability for LLMs, RAG apps, AI agents, and ML models.

OpenJudge is an Apache 2.0 open-source AI evaluation framework shipping 50+ benchmark-validated graders for agents, LLMs, code, math, and multimodal models.

Open-source LLM observability: trace agents, manage prompts, and run evals on one MIT-licensed platform.

Open-source LLM observability and agent evaluation you can trace, self-host, and eval end to end.

Open source AI engineering platform for agent and LLM tracing, evaluation, prompt management, and ML lifecycle work.

Maxim AI simulates, evaluates and observes AI agents — with Bifrost, its open-source LLM gateway, for routing and guardrails.

Galileo turns offline AI evals into production guardrails for agents and RAG pipelines.

Open-source Python framework that traces every AI agent span and scores runs with benchmarked, explainable LLM judges.

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

Comet's Opik brings LLM observability and evaluation that turns agent traces into code fixes

Laminar delivers open-source AI agent observability that auto-captures every LLM and tool call and surfaces failures with Signals.

Cekura tests, monitors, and self-improves voice AI agents with automated QA loops.

Agnost AI monitors production AI agents, clusters silent failures, and opens a fix for review.

OpenAI's December 2025 wet-lab evaluation where GPT-5 improved a real molecular cloning protocol 79-fold

Zero-config local dashboard that shows what your OpenClaw agents actually did, what they cost, and whether they leaked secrets

Nebuly turns the conversations employees and customers have with your AI agents into adoption, fluency and ROI numbers for enterprise leaders.

LangWatch is an open-source LLMOps platform for agent testing, LLM evaluation and OpenTelemetry-native LLM observability.

AI quality workspace for LLM evaluation, production observability, red teaming, and governance

Track AI spend across OpenAI, Anthropic, Google AI, Bedrock and Azure in one live cost dashboard.

OpenLIT delivers OpenTelemetry-native LLM tracing, evals, guardrails, and prompt management you self-host free under Apache 2.0.

Local, MIT-licensed token usage and cost tracking for AI coding agents — reads the logs your agents already write.

Chronicle Labs replays your production data to test and validate AI agents before launch.

Open-source benchmark that scores AI agents on real, multi-step software-company work tasks.

Sharbo builds a skill network for AI agents — encode expert workflows once and let every agent activate them autonomously.

PandaProbe is open-source agent observability that traces runs, evaluates outcomes, and turns failures into validated fixes via its Repair

Burntop is a FastAPI, React 19 and Postgres full-stack template that keeps coding agents honest with 200+ end-to-end tests.

OpenCompass (司南) benchmarks LLMs, VLMs, and AI4S models on dated, dimension-by-dimension leaderboards

Slack-native continuous improvement for production AI agents: triage failures, isolate root causes, validate fixes before you ship.

AI cost tracking that turns 50+ provider billing files into one normalized spend dashboard.