Alternatives to My Virtual Office

Arize Phoenix is open-source LLM observability: trace agent steps, run evals, and self-host your traces.

Dash0 is OpenTelemetry-native observability where Agent0 investigates incidents, finds root cause, and opens fix PRs.

Open-source LLM observability and agent evaluation you can trace, evaluate, and self-host for free.

Silico is Goodfire's interpretability agent for understanding and debugging the internals of your AI models.

LangSmith is agent and LLM observability: trace, monitor, and evaluate AI agents in cloud, BYOC, or self-hosted.

Open-source LLM observability and agent evals: trace, evaluate, and improve production AI agents with MIT-licensed tooling.

LangWatch is an open-source LLMOps platform for agent testing, LLM evaluation and OpenTelemetry-native LLM observability.

Galileo AI Evals turns offline evaluations into production guardrails that gate your AI agents in real time.

Arena AI ranks chat models, coding agents and fullstack builds on live head-to-head human votes.

Opik by Comet turns LLM traces into root-cause groupings, eval scores and code fixes so agent teams stop shipping the same bug twice

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

LLM evaluation, observability, and red teaming in one workspace — ship AI you can actually trust

TruLens traces AI agent runs with OpenTelemetry-native evals, showing where an agent fails and where you can cut cost.

Open source AI engineering platform for agent and LLM tracing, evaluation, prompt management, and ML lifecycle work.

ToolSpend tracks AI API spend across OpenAI, Anthropic, Google AI, Bedrock and Azure in one live cost dashboard.

LangChain builds open-source agent frameworks — langchain, langgraph and deepagents — plus LangSmith for agent observability, evals and

Agent evaluation platform that simulates voice and chat agents, traces production, and scores hallucinations before customers hit them

Athina AI is a collaborative AI development platform for managing prompts, running LLM evaluations, and monitoring production traces in one

Fiddler AI is an enterprise AI control plane for agent observability, inline guardrails, and auditable AI governance.

Open-source AI coworker workspace that builds, schedules and ships agents to Slack or Telegram

Mastra is an open-source TypeScript agent framework for durable agents, typed workflows, and built-in evals.

Lyzr's Opencontroller is an AI agent control plane to run, monitor, and govern enterprise agents built on any framework.

Maxim AI evaluates, simulates and observes AI agents — with Bifrost, its open-source LLM gateway, handling routing, budgets and guardrails.

Honeycomb Query Assistant turns plain-English questions into HQL against live production telemetry.

Weights & Biases tracks ML experiments and traces LLM apps so teams ship AI models faster

PostHog is product analytics with session replay, feature flags, error tracking, and a context warehouse for you and your AI agents.

Respan is an LLM gateway that routes, traces, and evaluates every agent run through one API.

Shared prompt library and AI chat workspace that keeps your ChatGPT, Claude, and Gemini prompts organized in one place.

Open-source Python framework that replaces vibe checks with reproducible evaluation loops for RAG pipelines and AI agents.

Evidently AI is an open-source Python framework for LLM evaluation, RAG testing, and ML model monitoring under Apache 2.0.