Alternatives to Etched AI

Anyscale Endpoints runs distributed training, batch inference, and multimodal data curation on managed Ray GPU clusters.

Groq is an inference neocloud built for sub-200ms LPU inference — fast open-weight model serving for real-time chat, voice, and agent workloads.

Cerebras delivers ultra-fast AI inference on wafer-scale hardware for latency-critical agents and apps.

Together Compute is an AI-native cloud for running open-source models — serverless inference, batch jobs, model shaping, and GPU clusters in one platform.

Multimodal AI inference platform with OpenAI-compatible APIs, dedicated GPUs, and day-zero frontier models like Qwen3.8-Max and Kimi K3.

Flat-rate inference on open LLMs with continual optimization for agentic coding and production workloads.

DeepInfra is a serverless inference cloud serving 100+ open models — DeepSeek-V4-Flash-0731 at $0.06 per 1M input tokens — through one OpenAI-compatible API

NVIDIA's open-source library for optimizing LLM and visual generation inference on NVIDIA GPUs with specialized kernels and a Python API.

Microsoft's open-source 1-bit LLM inference framework for fast, lossless CPU and GPU deployment

Unified AI inference stack from GPU kernel to API endpoint, portable across NVIDIA, AMD, TPU, Trainium, and Qualcomm silicon.

Runware: one AI inference API for image, video, audio, 3D and LLMs at PAYG rates

Rebellions builds chiplet-based AI inference accelerators — the Rebel100 chip plus RebelCard, RebelServer, RebelRack and RebelPOD systems — for enterprises and

Custom RDU hardware for fast inference on open models, sold as racks and cloud capacity.

Mistral sells frontier open-weight AI models, long-horizon Vibe agents, and document intelligence you can self-host or run on EU

SGLang is the open-source LLM inference engine for high-throughput, low-latency serving across NVIDIA, AMD, TPU, and NPU hardware.

vLLM is the open-source high-throughput LLM inference and serving engine with PagedAttention and an OpenAI-compatible API.

Decentralized, unfiltered AI inference on a peer-to-peer GPU network.

Pioneer is a self-improving inference API that routes every call to the right model and retrains itself from your production traffic.

Open-source Kubernetes operator that deploys and autoscales LLMs, embeddings, reranking, and speech-to-text with an OpenAI-compatible API.

LocalAI runs text, voice, vision, image, 3D and agent workloads on hardware you own — no per-token fees.

MAX Engine serves open-source LLMs through an OpenAI-compatible API on NVIDIA, AMD, and Apple silicon with no CUDA or PyTorch dependency.

Predibase is a managed platform for fine-tuning and serving open-source LLMs, now part of Rubrik.

One free REST API for text, image, audio, and video generation — no API key required

Free, community-powered AI image and text generation from volunteer GPUs.

Run large language models at home by joining a BitTorrent-style network that serves the rest of the model for you

Novita AI is the AI-native cloud for developers — 200+ models via one API, plus an Agent Sandbox and per-second GPUs.

Mesh LLM splits giant open-weight models across your own GPUs and serves them behind one local OpenAI-compatible API.

Unified LLM API gateway: one OpenAI-compatible endpoint for 96+ text, image, and video models at up to 90% off list price.

Open-source distributed model serving framework that turns mismatched machines into one self-hosted AI cluster