Alternatives to TheAgentCompany

AppWorld is a simulated-world benchmark for evaluating AI coding agents across 9 apps and 457 APIs.

Open-source toolkit for benchmarking vision-language models across 80+ multimodal tasks, with rankings published on the Open VLM Leaderboard.

OpenJudge is an open-source AI evaluation framework with 50+ production-grade graders for agents, LLMs, and multimodal models.

Arena AI is a free LLM leaderboard where live head-to-head battles and community votes rank chat models, coding agents, and fullstack code.

Open-source TypeScript framework for building durable AI agents and workflows, with a hosted platform for observability and cloud deployment.

A Carnegie Mellon research benchmark of 910 visually grounded web tasks for multimodal browser agents, scored by execution rather than string matching.

BALROG is an open ICLR-published benchmark that scores agentic LLM and VLM reasoning across seven procedurally generated games.

Polymath builds simulation environments where autonomous AI agents train and are evaluated on long-horizon, multi-tool tasks

Accordion is a free, open-source context visualization and management extension for coding agents — fold, unfold, and steer the context

OpenCompass (司南) benchmarks LLMs, VLMs, and AI4S models against 100+ open evaluation datasets with published, dated leaderboards

Open visual document retrieval benchmark and ColPali-style model suite for evaluating enterprise RAG retrievers on visually rich documents.

OMNI is an open-source shell hook that stops your coding agent paying twice for terminal output it has already read.

ClawBench benchmarks AI browser agents on live websites with HTTP-interception scoring and LLM-judge grading.

PandaProbe is open-source agent observability plus a Repair Harness that turns production failures into validated, reusable rules.

Agent and LLM observability from the LangChain team: trace, monitor, and evaluate agents in production, cloud, BYOC, or self-hosted.

Simulation-first evaluation and training infrastructure for AI agents, built on Digital World Models.

Independent AI leaderboard scoring 400+ models from every major lab on one composite number that blends benchmark results with live API speed and pricing.

Free public Hugging Face leaderboard ranking LLMs on agentic tasks like planning, tool use, and instruction following

Local, MIT-licensed token and cost observability for AI coding agents — no SDK, no signup, nothing leaves your machine.

MathArena is a free LLM math benchmark leaderboard scoring frontier models on ArXivLean proofs, BrokenArXiv, and ArXivMath competition

Self-hosted layer that gives your AI coding agents shared memory, managed MCP tools, and cross-model audit.

Free browser benchmark that ranks AI models on 3D voxel build prompts and human votes.

Kiln is a local-first AI workbench for building, evaluating, and optimizing AI systems on your own machine.

Silico is Goodfire's interpretability agent for understanding, debugging, and controlling the internals of your AI models.

Agent evaluation, simulation and tracing platform that helps you catch hallucinations before customers do

Fiddler AI is an enterprise AI control plane for agent observability, guardrails, and governance across the agentic lifecycle.

Honeycomb's natural-language query layer that turns plain-English questions into HQL against your live telemetry.

Weights & Biases tracks ML experiments and traces LLM apps so teams can ship AI models faster

Hume AI provides real human feedback, simulation, and expression measurement for emotionally intelligent voice AI.

Paste one prompt, see how 40+ AI models answer it, then pick the one that's best, fastest, or cheapest.