Features
Multi-language SDK: JS/TS, Go, Python, Dart
Unified generation API with streaming and tool calling
Plugin integration for Gemini, OpenAI, Anthropic, xAI, DeepSeek, Ollama
Middleware system for retries, fallback, tool approval
Dotprompt templating and management (TS, Dart 0.14.0+)
Local Developer UI for debugging and tuning prompts
Gemini Nano on-device inference
Image generation and multimodal output
Agentic app scaffolding with built-in tool use
Open-source, Apache 2.0 licensed
Type-safe API with TypeScript and Go
Compatible with Firebase and Google Cloud services
@ai_fn decorator for LLM-powered Python functions
@ai_classifier decorator for text classification
Structured data extraction via Pydantic models
Agent loops with tool calling and function calling
Built-in streaming (SSE) support
Async-first API for concurrent applications
Rate limiting and automatic retries
LLM response caching for performance
Concurrency control for workload management
CLI tool for monitoring and debugging
SQLite state store for persistence
OpenAI and Anthropic model support
Embeddings generation for semantic search
Local execution with no cloud dependency
Self-hosted deployable as a library
