Alternatives to Nos

vLLM turns open-weight LLMs into high-throughput, OpenAI-compatible inference endpoints on your own GPUs.

Run fast, self-hosted inference for LLMs, vision-language and diffusion models with SGLang serving.

Modal's serverless GPU cloud runs Python functions and sandboxes with per-second billing, spinning up GPU inference and agent compute from

Serverless AI inference on 100+ open models via an OpenAI-compatible API, billed per token with no GPU overhead.

Cerebras inference cloud: frontier LLMs at up to 750 tokens/sec for real-time agents and voice AI.

Run open-weight model inference on Together AI — serverless APIs, batch jobs, and GPU clusters.

Rent GPU pods, Serverless inference endpoints and multi-node GPU clusters by the second on Runpod's AI developer cloud.

Lilac turns idle GPU clusters into a white-labeled neocloud with spot H100 leases and serverless inference.

Rebellions builds chiplet-based AI inference hardware — Rebel100 silicon, RebelCard, RebelServer, RebelRack and RebelPOD for enterprise LLM

PEFT is Hugging Face's free library for parameter-efficient fine-tuning of LLMs, vision and diffusion models.

Predibase was a LoRA fine-tuning and multi-LoRA inference platform for open-source LLMs — now under Rubrik.

European GPU cloud with self-service NVIDIA GB300, B300 and H200 instances plus serverless GPU inference

Crusoe Cloud GPU instances, serverless inference, and fine-tuning priced for AI teams that want orchestration included

Synexa AI runs 100+ image, video, and 3D diffusion models through one serverless GPU API call at up to 60% below Replicate and Fal.ai.

BentoML's open-source recipe for packaging Stable Diffusion and Flux checkpoints into scalable inference APIs.

Groq delivers fast LLM inference on its own LPU and LPX silicon through an OpenAI-compatible API.

Run fast, production-grade GPU inference on dedicated GPUs or token-priced Model APIs — with per-minute billing.

Runware is one inference API for 400K+ image, video, audio, LLM and 3D models on a single endpoint.

Fireworks AI runs open-model inference with per-token pricing, model routing, and fine-tuning on one platform.

Cerebrium is a serverless GPU platform for real-time AI, with memory and GPU snapshotting that restores CUDA workloads in about 3.38

MAX Engine delivers OpenAI-compatible inference of open models across NVIDIA, AMD, Apple silicon, CPUs, and ASICs from one package.

Serverless APIs for 200+ open-weight LLM, image, audio, video and vision models, plus GPU cloud and an agent sandbox.

CoreWeave is the AI-native GPU cloud for training, reinforcement learning post-training, and low-latency inference on NVIDIA cluster-scale

LLaMA-Factory fine-tunes 100+ LLMs and VLMs with a zero-code CLI, LlamaBoard web UI and QLoRA

Serverless GPU compute with forkable microVMs and millisecond-billed sandboxes for AI agents.

Salad Cloud rents idle consumer GPUs from $0.015 per GPU-hour, billed per second, for retryable inference and batch work.

TensorRT-LLM is NVIDIA's open-source inference library for high-throughput LLM and visual generation serving on NVIDIA GPUs.

One API key for 1,000+ image, video, audio, 3D and LLM models on pay-per-use inference pricing

Axelera AI builds European edge inference accelerators — Metis and Europa AIPUs for vision, agentic and GenAI workloads from M.2 modules to

FuriosaAI's RNGD inference accelerators deliver LLM serving in 3 kW air-cooled racks behind an OpenAI-compatible API.