Alternatives to TypeLLM

Open-source Python library that constrains LLM decoding with finite-state machines so Pydantic, JSON Schema, regex, and grammar outputs come out valid every

Mistral OCR turns PDFs, scans, forms, and handwriting into markdown or structured JSON through a developer API.

Free, open-source desktop app for running and fine-tuning RWKV RNN language models locally with infinite context.

Run 1000+ local LLMs offline in Atomic Chat, a free open-source AI chat app for Mac, Windows, iOS and Android.

Free open-source Python framework for structured data extraction from documents using LLMs

AI-assisted technical report generation for engineers and environmental professionals.

Predibase is a managed platform for fine-tuning and serving open-source LLMs, now part of Rubrik.

Free, open-source desktop app to run 123 HuggingFace models locally or route prompts to Claude, GPT, Gemini and DeepSeek with your own API keys

Open-source RAG engine that turns messy documents into a trustworthy context layer for AI agents, with ETL, hybrid search and agentic retrieval.

Free browser-based data conversion and viewing tools for CSV, Parquet, GeoJSON, SQLite, and 52 other formats.

LM Studio runs open-source LLMs locally on your own machine, with Bionic as its agent for coding, documents, and automation.

OpenAI Cookbook: free GitHub repo of OpenAI API code examples, guides, and Jupyter notebooks.

Free, MIT-licensed local LLM inference for Apple Silicon Macs, with SSD-backed prefix caching and native OpenAI and Anthropic APIs.

LFM2.5 is Liquid AI's open-weight on-device AI family, running native text, vision, and audio models locally on CPU, GPU, or NPU.

Open-source context intelligence and persistent memory for LLM agents, deduping and compressing in ~12ms with no LLM calls.

Free on-device text-to-speech model you run locally through ONNX Runtime, no cloud round-trip and no per-character bill.

Open-source Go SDK giving one unified API across 25+ LLM providers with streaming, typed structured output, and MCP support.

Turn messy text into typed, queryable Semantic DataFrames with Python

spaCy is an industrial-strength open-source NLP library for production Python pipelines and large-scale text processing.

Free open-source CLI that benchmarks local LLM throughput through Ollama and publishes results to a community database.

The open-source Python library for loading, fine-tuning, and running transformer models across text, vision, audio, and video.

Ruby gem for streaming open source LLMs from your own Ollama server

Free online OCR that turns images and PDFs into editable text in 20+ languages, with batch processing up to 1000 images.

Free, open-source document AI, team management, and growth tools that you self-host with your own API keys.

Sparrow turns PDFs and images into schema-defined JSON using ML, LLM, and Vision LLM extraction.

Free, MIT-licensed desktop app for running text and image prompts across 11 AI providers side by side.

Run LLMs, speech-to-text, and image generation fully offline on your device via a Kotlin Multiplatform library, an app, and an IDE plugin.

Open-source JavaScript library that runs small LLMs like Llama 3.2 1B Instruct inside the browser via WebAssembly and WebGPU.

NLTK is a free, open-source Python NLP library for tokenization, tagging, parsing, and corpus work.

Run open-source LLMs locally in containers with the Podman AI Lab extension for Podman Desktop.