Alternatives to Groq

GMI Cloud Inference Engine serves frontier multimodal models through one OpenAI-compatible API on dedicated NVIDIA GPUs.

DeepInfra runs serverless AI inference on 100+ open models with pay-per-token pricing and an OpenAI-compatible API.

MAX is Modular's AI serving and modeling framework: one package for NVIDIA, AMD, Apple silicon, and CPUs, with an OpenAI-compatible endpoint.

Open-source LLM inference and serving engine that turns open-weight checkpoints into OpenAI-compatible endpoints on your own GPUs.

KubeAI is a Kubernetes operator for self-hosted LLM, embedding, reranking, and speech-to-text inference with an OpenAI-compatible API.

Rebellions builds chiplet-based AI inference hardware — Rebel100 silicon, RebelCard, RebelServer, RebelRack and RebelPOD for enterprise LLM

TensorRT-LLM is NVIDIA's open-source inference library for high-throughput LLM and visual generation serving on NVIDIA GPUs.

Mesh LLM splits giant open-weight models across your own GPUs and serves them as one local OpenAI-compatible endpoint on localhost:9337.

Etched builds custom inference silicon and rack-scale frontier inference clusters for trillion-parameter MoE prefill and decode.

One pay-as-you-go inference API for image, video, audio, LLM and 3D generation across 400K+ models.

Run 200+ open-weight LLMs, image and video models through one serverless Model API on Novita AI.

Wafer Pass swaps per-token inference billing for a flat-rate subscription on open models like GLM, Qwen, DeepSeek, and Kimi.

Run Llama 3.1 405B and other huge language models at home over a BitTorrent-style decentralized inference network.

SambaNova Cloud runs open-weight models like MiniMax M2.7 and DeepSeek-V3.1 on custom RDU chips for fast, power-efficient inference.

Cerebras runs frontier models at up to 750 tokens/sec for latency-critical AI agents and voice apps.

Together AI runs open-weight model inference through serverless APIs, batch jobs, and GPU clusters.

Managed Ray platform for distributed model training, multimodal data curation, and batch embedding generation on your own GPUs.

Open infrastructure giving builders one API for image, video, speech, music, text, agents and MCP tools

An open-source, readable LLM inference engine written in Python with hand-written CUDA and Triton kernels.

Parallax is a distributed model serving framework for building your own self-hosted LLM cluster from mismatched machines.

Predibase fine-tunes and serves open-source LLMs with LoRA — now tied to Rubrik, so verify it's still sold.

EnCharge AI builds analog in-memory computing silicon that runs AI inference at roughly 200 TOPS on about 8 watts.

Turn your own GPU fleet into an OpenAI-compatible token factory with self-hosted MaaS and GPUaaS

No-code LLM fine-tuning GUI for private, air-gapped model customization on your own data.

Open-source serving engine for LLMs, vision-language and diffusion models on GPUs you already own.

Decentralized, unfiltered AI inference on a peer-to-peer GPU network.

Open-source worker client that donates your idle GPU or CPU cycles to the AI Horde so anyone can generate images and text for free.

Run image, video, speech, music and LLM models through one Replicate API call and one bill

Deploy AI models in production with dedicated GPU inference and pre-optimized Model APIs.

Rent GPU pods, serverless inference endpoints and multi-node clusters by the second on Runpod's AI developer cloud.