Alternatives to Axelera AI

FuriosaAI builds RNGD inference accelerators and the 3 kW NXT RNGD Server for power-efficient LLM serving in standard air-cooled racks.

Hailo builds DRAM-free edge AI accelerators and AI vision processor SoCs for on-device deep learning and generative AI

Verda (formerly DataCrunch) is a European GPU cloud: on-demand NVIDIA instances, InfiniBand clusters, and serverless inference.

DeepInfra runs serverless AI inference on 100+ open models with pay-per-token pricing and an OpenAI-compatible API.

Together AI runs open-weight model inference through serverless APIs, batch jobs, and GPU clusters.

Rent GPU pods, serverless inference endpoints and multi-node clusters by the second on Runpod's AI developer cloud.

Serverless GPU compute for AI agents: forkable microVMs, sandboxes, and inference endpoints billed by the second.

Lilac turns idle GPU clusters into a white-labeled neocloud with spot H100 leases and serverless inference.

Rebellions builds chiplet-based AI inference hardware — Rebel100 silicon, RebelCard, RebelServer, RebelRack and RebelPOD for enterprise LLM

Rain AI is a pre-production hardware company building energy-efficient, brain-inspired analog in-memory chips for ultra-low-power AI inference at the edge.

NOS is an open-source PyTorch inference server that serves LLMs, diffusion, embeddings, speech-to-text and object detection from one

Serverless GPU cloud for production AI — declare Python functions and hardware in one file, scale to thousands of GPUs, pay per second.

Groq delivers fast LLM inference on its own LPU and LPX silicon through an OpenAI-compatible API.

Deploy AI models in production with dedicated GPU inference and pre-optimized Model APIs.

One pay-as-you-go inference API for image, video, audio, LLM and 3D generation across 400K+ models.

Fireworks AI runs open-weight model inference, orchestration and training on one platform with per-token and per-GPU-second pricing.

Serverless GPU platform for real-time AI, with memory and GPU snapshotting that cuts cold starts to roughly 3.4s.

Vast.ai is a GPU rental marketplace where market-set prices and per-second billing let you provision 20,000+ GPUs from code.

Free Apache-2.0 command-line framework for fine-tuning and post-training LLMs, vision-language and MoE models on GPUs you own or rent

CoreWeave is the AI-native GPU cloud for training, reinforcement learning post-training, and low-latency inference on NVIDIA cluster-scale

Salad Cloud rents idle consumer GPUs from $0.015 per GPU-hour, billed per second, for retryable inference and batch work.

TensorRT-LLM is NVIDIA's open-source inference library for high-throughput LLM and visual generation serving on NVIDIA GPUs.

Open-source LLM inference and serving engine that turns open-weight checkpoints into OpenAI-compatible endpoints on your own GPUs.

PEFT is Hugging Face's free library for parameter-efficient fine-tuning of LLMs, vision and diffusion models.

Modular's unified inference stack runs the same container and OpenAI-compatible API from GPU kernel to cloud endpoint

Deploy custom ML models on serverless Nvidia GPUs with per-second billing and scale-to-zero.

ViewComfy turns ComfyUI workflows into no-code web apps and autoscaling serverless APIs, billed per active GPU second.

GMI Cloud Inference Engine serves frontier multimodal models through one OpenAI-compatible API on dedicated NVIDIA GPUs.

Rent private bare-metal GPU servers in the EU with one-click vLLM, OpenWebUI and ComfyUI AI templates.

Parallax is a distributed model serving framework for running self-hosted LLM inference across scattered GPUs, Macs, and workstations.