Alternatives to Bocoel

OpenCompass (司南) benchmarks LLMs, VLMs, and AI4S models on 100+ open evaluation datasets with dated leaderboards

Free public leaderboard benchmarking LLMs on competition math and Lean proof benchmarks like ArXivMath and ArXivLean.

Silico is Goodfire's interpretability agent for understanding and debugging the internals of your AI models.

Fiddler AI is an enterprise AI control plane for agent observability, inline guardrails, and auditable AI governance.

Weights & Biases tracks ML experiments and traces LLM apps so teams ship AI models faster

Open-source benchmark that runs AI browser agents on live websites and scores the HTTP request they actually fire.

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

TruLens traces AI agent runs with OpenTelemetry-native evals, showing where an agent fails and where you can cut cost.

Open-source Python framework that replaces vibe checks with reproducible evaluation loops for RAG pipelines and AI agents.

Evidently AI is an open-source Python framework for LLM evaluation, RAG testing, and ML model monitoring under Apache 2.0.

Developer observability platform that traces, replays, and debugs AI agent runs across OpenAI, CrewAI, Autogen and 400+ LLMs

Braintrust is an agent observability platform that traces AI runs, scores quality with evals, and surfaces production failure patterns.

ViDoRe Benchmark: an open visual document retrieval benchmark and ColPali model suite for enterprise RAG evaluation.

An independent AI leaderboard ranking 408 models on one LLM Stats Score that blends benchmarks with live API speed and price.

Open-source benchmark that scores AI agents on real, multi-step software-company work tasks.

AppWorld is a simulated-world benchmark for evaluating AI coding agents across 9 apps and 457 APIs.

BALROG is an open ICLR-published benchmark that scores agentic LLM and VLM reasoning across seven procedurally generated games.

VisualWebArena is a 910-task benchmark from Carnegie Mellon that scores multimodal browser agents on whether they actually complete visual web tasks.

Free daily LLM speed benchmarks — compare time-to-first-token and tokens-per-second across models and regions.

Open-source toolkit for benchmarking vision-language models across 80+ multimodal tasks, with rankings published on the Open VLM Leaderboard.

OpenJudge is an Apache 2.0 open-source AI evaluation framework shipping 50+ benchmark-validated graders for agents, LLMs, code, math, and multimodal models.

PandaProbe is open-source agent observability that traces runs, evaluates outcomes, and turns failures into validated fixes via its Repair

Arize Phoenix is open-source LLM observability: trace agent steps, run evals, and self-host your traces.

Dash0 is OpenTelemetry-native observability where Agent0 investigates incidents, finds root cause, and opens fix PRs.

Open-source LLM observability and agent evaluation you can trace, evaluate, and self-host for free.

LangSmith is agent and LLM observability: trace, monitor, and evaluate AI agents in cloud, BYOC, or self-hosted.

Open-source LLM observability and agent evals: trace, evaluate, and improve production AI agents with MIT-licensed tooling.

Galileo AI Evals turns offline evaluations into production guardrails that gate your AI agents in real time.

Arena AI ranks chat models, coding agents and fullstack builds on live head-to-head human votes.

Opik by Comet turns LLM traces into root-cause groupings, eval scores and code fixes so agent teams stop shipping the same bug twice