Alternatives to Mini Infer

TensorRT-LLM: NVIDIA's open-source library for high-throughput LLM and visual generation inference

vLLM turns open-weight LLMs into high-throughput, OpenAI-compatible inference endpoints on your own GPUs.

MAX Engine delivers OpenAI-compatible inference of open models across NVIDIA, AMD, Apple silicon, CPUs, and ASICs from one package.

CoreWeave is the AI-native GPU cloud for training, reinforcement learning post-training, and low-latency inference on NVIDIA cluster-scale

Fast open-weight LLM inference on SambaNova's own RDU silicon — MiniMax M3.1 Flash, MiniMax M2.7, DeepSeek-V3.1 and gpt-oss-120b.

Run fast, self-hosted inference for LLMs, vision-language and diffusion models with SGLang serving.

Groq delivers fast LLM inference on its own LPU and LPX silicon through an OpenAI-compatible API.

One inference API for 400K+ image, video, audio, LLM and 3D models, plus serverless GPUs starting at $0.63/GPU-hour reserved.

Serverless AI inference on 100+ open models via an OpenAI-compatible API, billed per token with no GPU overhead.

Cerebras inference cloud runs frontier LLMs in Ultrafast mode at up to 750 tokens/sec for real-time agents and voice AI.

Rebellions builds chiplet-based AI inference hardware — Rebel100 silicon, RebelCard, RebelServer, RebelRack and RebelPOD for enterprise LLM

Multimodal inference API on dedicated NVIDIA GPUs with an OpenAI-compatible endpoint

Flat-rate subscription offering unlimited inference on open models GLM, Qwen, DeepSeek, and Kimi, tuned continuously for your traffic type.

European GPU cloud with self-service GB300, B300 and B200 instances plus per-token open-weight inference

Run Llama 3.1 405B and other huge language models at home over a BitTorrent-style decentralized inference network.

KubeAI is a Kubernetes operator for self-hosted LLM, embedding, reranking, and speech-to-text inference with an OpenAI-compatible API.

Zettascale builds XPU accelerator chips that cut AI inference and training energy by keeping data close to compute.

Etched builds custom inference silicon and rack-scale frontier inference clusters for trillion-parameter MoE prefill and decode.

Modal's serverless GPU cloud runs Python functions and sandboxes with per-second billing, spinning up GPU inference and agent compute from

FuriosaAI's RNGD inference accelerators deliver LLM serving in 3 kW air-cooled racks behind an OpenAI-compatible API.

Parallax is a distributed model serving framework for building your own self-hosted AI cluster across scattered GPUs, Macs, and

Decentralized, unfiltered AI inference on a peer-to-peer GPU network.

Together AI is an AI cloud for open-weight models: per-token inference APIs with GPU clusters underneath.

Managed Ray platform for distributed model training, multimodal data curation, and batch embedding generation

Rent GPU pods, Serverless inference endpoints and multi-node GPU clusters by the second on Runpod's AI developer cloud.

One API for image, video, speech, music and text generation with hosted MCP agents

Fireworks AI runs open-model inference, ensembling and fine-tuning on one platform at per-token prices.

Rent GPUs on Vast.ai's marketplace — 20,000+ cards, per-second billing, and API-native provisioning agents can drive.

Novita AI runs 200+ open-weight LLM, image, audio, video and Vision models through one OpenAI-compatible serverless API.

LLaMA-Factory fine-tunes 100+ LLMs and VLMs with a zero-code CLI, LlamaBoard web UI and QLoRA