Alternatives to Opik (Comet)

OpenJudge is an Apache 2.0 open-source AI evaluation framework shipping 50+ benchmark-validated graders for agents, LLMs, code, math, and multimodal models.

Open-source research platform (COLM 2024) shipping three language agents — Data, Plugins and Web — in one chat UI, for free.

Open-source LLM observability, prompt management, and agent evals on one data model.

Open source AI engineering platform for agent and LLM tracing, evaluation, prompt management, and ML lifecycle work.

Open-source RAG engine with built-in ETL, hybrid search and visual agent orchestration for enterprise AI agents

Open-source Python framework that replaces vibe checks with reproducible evaluation loops for RAG pipelines and AI agents.

Open-source Python SDK plus AgentOS runtime for serving agents as a REST API and MCP server you host yourself.

Microsoft's open-source, code-first Python framework for building stateful, data-intensive conversational AI agents.

Open-source LLM observability and agent evaluation you can trace, score, and self-host on your own infrastructure.

Open-source LLM observability and agent evaluation you can trace, self-host, and eval end to end.

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

TruLens traces AI agent runs with OpenTelemetry-native evals, showing where an agent fails and where you can cut cost.

Open-source agent frameworks (langchain, langgraph, deepagents) plus LangSmith for tracing, evals, deployment and governance.

Open-source Python framework to evaluate LLM, RAG, and agent quality and monitor ML drift under Apache 2.0.

Galileo is an AI observability and eval engineering platform that turns offline evals into production guardrails for agents and RAG.

Open-source agentic AI data assistant that writes SQL, runs code in a sandbox, and chats with your databases self-hosted

Open-source agent platform that fuses knowledge graphs with RAG for self-hosted, explainable enterprise AI.

Local, MIT-licensed token usage and cost tracking for AI coding agents — reads the logs your agents already write.

Laminar is open-source agent observability that auto-captures every LLM and tool call and flags agent failures you never wrote a detector

OpenLIT delivers OpenTelemetry-native LLM tracing, evals, guardrails, and prompt management you self-host free under Apache 2.0.

Burntop now ships as a full-stack FastAPI, React 19 and Postgres template that keeps coding agents honest with 200+ end-to-end tests.

LangSmith is agent and LLM observability: trace, monitor, and evaluate AI agents in cloud, BYOC, or self-hosted.

Co-own autonomous AI agents that trade, hire each other and settle payments on-chain with OLAS staking.

Dash0 is OpenTelemetry-native observability with Agent0 doing autonomous root cause analysis and fix PRs.

Galileo runs your pre-launch evals as live guardrails, scoring 100% of agent traffic with distilled Luna models.

Track AI spend across OpenAI, Anthropic, Google AI, Bedrock and Azure in one live cost dashboard.

Enterprise agent workforce platform for building, operating, and governing AI agents across on-prem, hybrid, and multi-cloud environments.

Open-source workspace for AI coworkers you run and automate from Slack or Telegram

Maxim AI simulates, evaluates and observes AI agents — plus Bifrost, its Apache 2.0 LLM gateway for routing, budgets and guardrails.

PostHog is your product's context layer: analytics, replays, errors, logs, and business data in one warehouse you and your AI agents can query.