Ruby Llm

RubyLLM is an open-source Ruby gem that provides a unified, elegant interface for interacting with over 20 AI providers, including OpenAI, Anthropic, Gemini, Bedrock, DeepSeek, Mistral, Ollama, OpenRouter, Perplexity, GPUStack, xAI, and any OpenAI-compatible provider. It enables developers to build chatbots, AI agents, RAG applications, content generators, and multimodal workflows with minimal boilerplate. The framework supports chat, vision, audio transcription, document analysis, image generation, embeddings, moderation, structured output, streaming, and tool calling—all through a consistent Ruby API. Unlike provider-specific SDKs, RubyLLM requires only three dependencies (Faraday, Zeitwerk, and Marcel) and lets you switch models or providers by simply changing a configuration string. It integrates seamlessly with Rails via ActiveRecord and provides async execution using fibers. The included model registry offers capability detection and pricing for 800+ models, making it easy to choose the right model for each task. Key features include conversational AI chat, vision analysis of images and videos, audio transcription, document extraction from PDFs/CSVs/JSON, image generation, embeddings, content moderation, reusable agents with instructions and tools (RubyLLM::Agent), structured JSON output, real-time streaming, and extended thinking (control and persist model deliberation). RubyLLM also supports tool calling where AI invokes your Ruby methods. RubyLLM is maintained by Carmine Paolino and is battle-tested in production at Fully Private Work AI. Its minimalist design and broad provider support make it a strong alternative to heavier frameworks like LangChain for Ruby developers who want a clean, lightweight AI integration layer.