Alternatives to ToolSpend

Token Monitor is a free desktop widget that tracks AI coding token usage, cost, and quota limits across 44+ tools and providers.

Local, MIT-licensed token usage and cost tracking for AI coding agents — reads the logs your agents already write.

Galileo runs your pre-launch evals as live guardrails, scoring 100% of agent traffic with distilled Luna models.

TruLens traces AI agent runs with OpenTelemetry-native evals, showing where an agent fails and where you can cut cost.

Honeycomb Query Assistant turns plain-English questions into HQL against live production telemetry.

Weights & Biases tracks ML experiments, versions models and datasets, and traces LLM apps — now inside CoreWeave Forge

Comet's open-source platform for tracing AI agents, running LLM-as-a-judge evals, and auditing coding-agent spend.

Neptune.ai tracks and compares deep-learning training runs in real time, down to individual model layers.

NannyML estimates your ML model's live performance without ground-truth labels and alerts you only when it actually matters

Helicone is an AI gateway and LLM observability platform that routes, caches, and logs traffic across 100+ model providers.

Free daily LLM speed benchmarks — compare time-to-first-token and tokens-per-second across models and regions.

OpenLIT delivers OpenTelemetry-native LLM tracing, evals, guardrails, and prompt management you self-host free under Apache 2.0.

LangSmith is agent and LLM observability: trace, monitor, and evaluate AI agents in cloud, BYOC, or self-hosted.

Open-source LLM observability and agent evaluation you can trace, score, and self-host on your own infrastructure.

Dash0 is OpenTelemetry-native observability with Agent0 doing autonomous root cause analysis and fix PRs.

Open-source LLM observability and agent evaluation you can trace, self-host, and eval end to end.

Silico is Goodfire's mechanistic interpretability agent for understanding, debugging, and steering the internals of your AI models.

Open-source LLM observability, prompt management, and agent evals on one data model.

Comet's Opik turns LLM traces into grouped root causes, eval scores and proposed code fixes

Open-source OpenTelemetry tracing, versioning, and sessions for Python LLM apps—bring your own backend.

LLM evaluation, observability, and red teaming in one workspace for teams shipping production AI

Open source AI engineering platform for agent and LLM tracing, evaluation, prompt management, and ML lifecycle work.

Athina is a shared workspace where your team writes prompts, runs evals, annotates datasets, and traces LLM calls in production.

Fiddler AI is an enterprise control plane for agent observability, inline guardrails, and auditable AI governance.

Open-source workspace for AI coworkers you run and automate from Slack or Telegram

Maxim AI simulates, evaluates and observes AI agents — plus Bifrost, its Apache 2.0 LLM gateway for routing, budgets and guardrails.

PostHog is your product's context layer: analytics, replays, errors, logs, and business data in one warehouse you and your AI agents can query.

Open-source Python library that turns vibe checks into reproducible evaluation loops for RAG pipelines and AI agents.

Open-source Python framework to evaluate LLM, RAG, and agent quality and monitor ML drift under Apache 2.0.

Galileo is an AI observability and eval engineering platform that turns offline evals into production guardrails for agents and RAG.