Alternatives to ToolSpend

Free open-source desktop widget tracking tokens, cost, and limits across 29+ AI coding tools.

ML experiment tracking and LLM development platform for teams

Open source platform to debug, evaluate, monitor, and optimize AI agents and ML models.

Real-time experiment tracking for frontier AI training, now owned by OpenAI

Daily-updated LLM speed benchmarks measuring TTFT, TPS, and total time across regions.

Free open-source AI usage tracking & analytics for developers

Open-source Python library to track the real-time carbon footprint of your GenAI API calls.

Pre-built AI models for finance, from fraud detection to agentic workflow orchestration.

Open-source LLM agent observability with tracing, evals, and experiments

OpenTelemetry-native observability with AI SRE Agent0 for automated production insight.

Open-source AI agent tracing and LLM-as-judge evaluation platform for debugging and improving agent quality.

Mechanistic interpretability platform to understand, debug, and design AI models

AI agent observability and evaluation platform for LLM apps

Open-source LLM observability for tracing, evaluating, and optimizing AI agents end-to-end.

AI observability and eval engineering platform that turns offline evals into production guardrails.

AI observability and evals that auto-fix agent code via git

Open-source OpenTelemetry observability for Python LLM apps

Enterprise LLM evaluation, observability, and red teaming in one platform.

OpenTelemetry-native open-source AI agent evaluation and tracing

Open-source AI observability for privacy-preserving logging and LLM security

Collaborative LLM development platform for building, testing, and monitoring AI features.

Enterprise AI control plane for observability, guardrails, and governance of agentic AI.

Open-source workspace to build, evaluate, and deploy AI agents through chat

Simulate, evaluate, and observe AI agents—ship reliable agents 5x faster with Maxim.

Turn plain English into production-ready Honeycomb queries for faster debugging.

PostHog is an open-source product OS that unifies analytics, session replay, feature flags, and a data warehouse in one platform.

Open-source framework to replace vibe checks with reproducible, LLM-driven evaluation loops for RAG and agents.

Open-source AI evaluation and observability for LLMs, RAG, agents, and predictive ML.

AI observability and eval engineering platform that turns offline evals into production guardrails.

Free, open-source AI observability and evals for debugging agents