Alternatives to Guidance

Open-source Python library for guaranteed valid structured outputs from LLMs

Open-source TypeScript toolkit for building AI apps with 100+ models, streaming, and agent support

Open-source Swift package wrapping the OpenAI API with async/await and Combine.

Free GitHub repo of OpenAI API code examples, guides, and Jupyter notebooks.

Run LLMs in-browser with WebGPU — headless React hooks, just useLLM().

Extra-small OpenAI-compatible AI SDK for JS — 40x smaller installs.

LMQL is a programming language for LLM interaction with typed constraints, nested queries, and multi-backend portability.

An open-source Python framework that turns ordinary functions into AI-powered tools via simple decorators.

Predibase by Rubrik: Fine-tune and serve open-source LLMs on managed infrastructure.

Open-source framework for building private, on-premise RAG applications with 100% local data control.

Google's open-source framework for building agentic AI apps in JS, Go, Python & Dart.

Open-source Python framework turning messy text into typed, queryable Semantic DataFrames

Open-source Java library for building LLM-powered apps with a unified API

GoAI SDK: one unified Go API across 25+ LLM providers with streaming, structured output, MCP support.

Open-source AI agent SDK for production-grade Python & TypeScript agents

Ruby gem for streaming open source LLMs via Ollama locally

Fast, open-source tokenization library for training custom vocabularies with BPE, WordPiece, Unigram.

Open-source Django library for adding AI assistants, chatbots, and RAG to your projects.

Open-source CLI framework for modular AI prompts and workflows

Open-source LLM that turns natural language into API calls for tool-using agents

Open-source streaming-first toolkit that turns AI agent output into interactive UI, not JSON.

Compress AI agent context by 60–90% with a local, open-source MCP server.

Open-source MCP testing & app framework for building ChatGPT Apps and Claude Connectors.

The standard Python library for loading, fine-tuning, and running transformer models across text, vision, and audio.

Fast Java tokenizer library for OpenAI GPT models using BPE

Open-source Rust CLI that filters command output before it hits your LLM

Open-source React chat UI components for LLM interfaces

Open-source tool for comparing chain-of-thought reasoning traces across AI backends

Open-source Python library to build and auto-optimize LLM workflows

Build LLM apps with decorators, observability, and full control.