Alternatives to Graphsignal Profiler

Maxim AI evaluates, simulates and observes AI agents — with Bifrost, its open-source LLM gateway, handling routing, budgets and guardrails.

Local, MIT-licensed token and cost observability for AI coding agents — reads the logs your agents already write.

AI SRE platform whose autonomous agents go on-call, triage alerts, investigate incidents and run production tasks alongside your engineers.

LangSmith is agent and LLM observability: trace, monitor, and evaluate AI agents in cloud, BYOC, or self-hosted.

Open-source LLM observability and agent evals: trace, evaluate, and improve production AI agents with MIT-licensed tooling.

Galileo AI Evals turns offline evaluations into production guardrails that gate your AI agents in real time.

Open-source AI coworker workspace that builds, schedules and ships agents to Slack or Telegram

PostHog is product analytics with session replay, feature flags, error tracking, and a context warehouse for you and your AI agents.

Open-source Python framework that replaces vibe checks with reproducible evaluation loops for RAG pipelines and AI agents.

Galileo is an AI observability and eval engineering platform that turns offline evals into production guardrails for agents and RAG.

Augury is industrial AI for machine health monitoring — predictive maintenance agents that catch equipment failure before it stops your

NannyML estimates your ML model's live performance without ground-truth labels and alerts you only when it actually matters

OpenJudge is an Apache 2.0 open-source AI evaluation framework shipping 50+ benchmark-validated graders for agents, LLMs, code, math, and multimodal models.

Chronicle Labs replays your production data to test and validate AI agents before launch.

Sazabi is AI-native observability: conversational debugging, autonomous alerts, and coding agents that open fix PRs.

Devgraph.ai builds a live ontology of your code, infrastructure, and tools so AI agents and engineers can trace ownership, dependencies, and impact in real

Autoheal runs audited AI SDLC agents that automate incident response, vulnerability remediation, and AI coding cost efficiency.

AI-native SRE platform whose specialised agents detect, diagnose, and remediate cloud, Kubernetes, and CI/CD incidents — including IT operations alerts by

Arize Phoenix is open-source LLM observability: trace agent steps, run evals, and self-host your traces.

Dash0 is OpenTelemetry-native observability where Agent0 investigates incidents, finds root cause, and opens fix PRs.

Open-source LLM observability and agent evaluation you can trace, evaluate, and self-host for free.

Silico is Goodfire's interpretability agent for understanding and debugging the internals of your AI models.

Opik by Comet turns LLM traces into root-cause groupings, eval scores and code fixes so agent teams stop shipping the same bug twice

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

LLM evaluation, observability, and red teaming in one workspace — ship AI you can actually trust

TruLens traces AI agent runs with OpenTelemetry-native evals, showing where an agent fails and where you can cut cost.

Open source AI engineering platform for agent and LLM tracing, evaluation, prompt management, and ML lifecycle work.

ToolSpend tracks AI API spend across OpenAI, Anthropic, Google AI, Bedrock and Azure in one live cost dashboard.

Athina AI is a collaborative AI development platform for managing prompts, running LLM evaluations, and monitoring production traces in one

Fiddler AI is an enterprise AI control plane for agent observability, inline guardrails, and auditable AI governance.