Alternatives to Private Gpt

LM Studio runs open-source LLMs locally with Bionic, an agent for coding, documents and automation.

Ollama runs open-weight LLMs locally or in the cloud with one command and an OpenAI-compatible API.

Free, open-source desktop app for running and fine-tuning RWKV RNN language models locally with effectively unbounded context.

Free open-source local AI server that runs LLMs, image, music, video, and 3D generation on your own Apple Silicon Mac.

Open-source, local-first desktop AI client that connects to multiple model providers and keeps your data on your machine.

Atomic Chat runs 1,000+ local LLMs offline on your own hardware — free, open-source, no account, no rate limits.

Enclave runs open-source AI models locally on your iPhone and Mac for private, fully offline AI chats.

Open-source Java library that tokenizes text with OpenAI's BPE encodings so you can count, encode and decode locally

Open-source Ruby gem that calls 11 LLM providers through one consistent interface for embeddings, completions, and chat.

Ruby gem for running open source LLMs locally through Ollama's API, with streaming, embeddings, and token tracking built in.

Predibase: managed fine-tuning and multi-LoRA serving for open-source LLMs, now inside Rubrik.

Open-source TypeScript AI SDK for streaming AI apps and agents across 100+ models with built-in fallbacks

Guidance is an open-source Python library for constrained LLM generation with regex, context-free grammars, and inline control flow.

Run any GGUF AI model locally on Android with zero network permissions

Free, MIT-licensed local LLM inference for Apple Silicon Macs, with SSD-backed prefix caching and native OpenAI and Anthropic APIs.

Mesh LLM splits giant open-weight models across your own GPUs and serves them as one local OpenAI-compatible endpoint on localhost:9337.

LocalAI is an MIT-licensed local AI runtime that serves text, voice, vision, image and agent workloads behind an OpenAI-compatible API.

A free, open-source desktop chat client that runs your own OpenAI, Azure OpenAI, Google, and Replicate API keys from one window.

Open-source JavaScript library that runs small LLMs like Llama 3.2 1B Instruct inside the browser via WebAssembly and WebGPU.

Open-source Ruby gem giving one unified API across Anthropic, DeepSeek, Google, Mistral, Llama, and OpenAI

Open-source Python library for loading, fine-tuning, and running transformer models across text, vision, audio, and video.

Open-source Rust tokenization library for training BPE, WordPiece and Unigram vocabularies at production speed.

Run local HuggingFace models or route prompts to Claude, GPT and Gemini with your own API keys

Free local RAG chatbot from NVIDIA that answers questions over your own files on an RTX Windows PC

OpenAI Cookbook delivers free, MIT-licensed Python notebooks and guides for building with the OpenAI API.

LFM2.5 is Liquid AI's open-weight foundation model family for on-device AI — native text, vision, and audio inference on CPU, GPU, or NPU.

Run Afterglow locally to turn exported QQ and WeChat chat logs into a searchable AI friend that answers in a real person's voice

Supertonic delivers free on-device text-to-speech you download and run locally via ONNX Runtime, with no per-character bill.

Mellea turns type-annotated Python functions into validated, testable LLM calls with token-level constrained decoding.

picoLLM is Picovoice's on-device LLM inference engine for running quantized language models locally on phones, embedded Linux, web, and microcontrollers.