Alternatives to Lilypad

Open-source, OpenTelemetry-native LLM observability and AI engineering platform for teams.

Open-source LLM agent observability with tracing, evals, and experiments

OpenTelemetry-native observability with AI SRE Agent0 for automated production insight.

Open-source LLM observability for tracing, evaluating, and optimizing AI agents end-to-end.

OpenTelemetry-native open-source AI agent evaluation and tracing

Open-source AI observability for privacy-preserving logging and LLM security

Open-source AI evaluation and observability for LLMs, RAG, agents, and predictive ML.

Free, open-source AI observability and evals for debugging agents

Open-source LLM observability and prompt management for AI engineering teams.

Open-source Python library to track the real-time carbon footprint of your GenAI API calls.

Open-source AI agent tracing and LLM-as-judge evaluation platform for debugging and improving agent quality.

AI agent observability and evaluation platform for LLM apps

Open source platform to debug, evaluate, monitor, and optimize AI agents and ML models.

Open-source workspace to build, evaluate, and deploy AI agents through chat

PostHog is an open-source product OS that unifies analytics, session replay, feature flags, and a data warehouse in one platform.

Open-source framework to replace vibe checks with reproducible, LLM-driven evaluation loops for RAG and agents.

AI gateway and LLM observability platform for routing, debugging, and analyzing AI apps

Open-source LLM & VLM evaluation platform for standardized benchmarking

Free open-source desktop widget tracking tokens, cost, and limits across 29+ AI coding tools.

Free open-source AI usage tracking & analytics for developers

AI observability and eval engineering platform that turns offline evals into production guardrails.

AI observability and evals that auto-fix agent code via git

Enterprise LLM evaluation, observability, and red teaming in one platform.

Enterprise AI control plane for observability, guardrails, and governance of agentic AI.

AI observability and eval engineering platform that turns offline evals into production guardrails.

Real-time experiment tracking for frontier AI training, now owned by OpenAI

Trace, debug, and deploy reliable AI agents with full observability

Active observability for AI agents: trace, evaluate, and discover patterns at scale.

AI agent observability that detects and auto-fixes silent failures in production.

Free local observability for AI coding agents — tokens, cost & traces on your machine.