Alternatives to LMCache

Rain AI is a pre-production hardware company building energy-efficient, brain-inspired analog in-memory chips for ultra-low-power AI inference at the edge.

Recogni's Tensordyne Napier is a rack-scale AI inference system running on logarithmic math silicon for multi-trillion-parameter MoE

Decentralized AI inference with sub-5ms latency and verifiable compute

EnCharge AI builds analog in-memory computing silicon that runs AI inference at roughly 200 TOPS on about 8 watts.

CoreWeave is the AI-native GPU cloud for large-scale model training, reinforcement learning, and low-latency inference on NVIDIA's newest

MAX Engine: OpenAI-compatible inference for open models, one stack across NVIDIA, AMD, Apple silicon, and Qualcomm.

Predibase: managed fine-tuning and multi-LoRA serving for open-source LLMs, now inside Rubrik.

Open-source local AI workspace for fine-tuning and running LLMs, image, and video models on your own GPU

Managed Ray platform for distributed model training, multimodal data curation, and batch embedding generation on your own GPUs.

TensorRT-LLM is NVIDIA's open-source library for maximum-throughput LLM and visual generation inference on NVIDIA GPUs.

Hailo builds edge AI processors — DRAM-free AI accelerators and AI vision processors that run deep learning on-device at low power.

European edge AI inference accelerators — the Metis and Europa AIPU lines run vision, agentic and GenAI workloads from embedded modules to server cards.

Nscale sells sovereign GPU training and inference capacity from AI data centers it owns and powers across Europe and the US.

Groq runs an inference cloud tuned for fast LLM inference on open-weight models, built on its LPU and LPX silicon.

High-performance AI inference platform for production ML models.

DeepInfra delivers serverless AI inference on 100+ open models through one OpenAI-compatible API key.

BitNet (bitnet.cpp) runs 1-bit and ternary BitNet b1.58 LLMs on CPU with lossless 1.58-bit inference — no GPU needed.

FuriosaAI builds RNGD inference accelerators and the 3 kW NXT RNGD Server for power-efficient LLM inference at rack scale.

Cloud GPU workspace with AUTOMATIC1111, ComfyUI, Forge, Fooocus, and Kohya pre-installed for Stable Diffusion, Flux, and video workflows.

Krutrim Cloud rents A100 80GB and H100 GPU instances in India with INR billing and data residency.

Runpod rents GPU pods, serverless inference endpoints and multi-node clusters by the second for AI workloads.

Cerebras inference runs GPT-5.6 Sol Ultrafast at up to 750 tokens/sec on wafer-scale hardware for latency-critical agents, code tools, and

Baseten deploys and serves open-source, fine-tuned, and custom AI models on dedicated GPUs and pre-optimized Model APIs.

One REST API for text, image, audio, and video generation — no API key needed to start

One inference stack — same container and OpenAI-compatible API across NVIDIA, AMD, TPU, Trainium, Qualcomm, and Apple silicon

Run image, video, speech, music and LLM models through one Replicate API with serverless per-second billing.

Together Compute is an OpenAI-compatible inference API for serving open-weight AI models at published per-token rates.

Modal runs serverless GPU compute for AI — declare Python logic and hardware in one file, scale from zero to thousands of GPUs.

Salad Cloud rents idle consumer GPUs from $0.015 per GPU-hour for retryable AI inference, image generation, transcription, and batch jobs.

LLaMA-Factory fine-tunes 100+ LLMs and VLMs through a zero-code CLI and the LlamaBoard web UI