Alternatives to Axolotl

vLLM turns open-weight LLMs into high-throughput, OpenAI-compatible inference endpoints on your own GPUs.

Predibase was a LoRA fine-tuning and multi-LoRA inference platform for open-source LLMs — now under Rubrik.

Fireworks AI runs open-model inference with per-token pricing, model routing, and fine-tuning on one platform.

Run 20+ pre-installed open-source AI apps — ComfyUI, Stable Diffusion, RVC, LoRA training — in your browser on rented cloud GPUs

Local LLM fine-tuning and GGUF inference with 2x faster Unsloth training

TensorRT-LLM is NVIDIA's open-source inference library for high-throughput LLM and visual generation serving on NVIDIA GPUs.

PEFT is Hugging Face's free library for parameter-efficient fine-tuning of LLMs, vision and diffusion models.

OpenAI-compatible multimodal inference API on dedicated NVIDIA GPUs, from $2.60/GPU-hour

Parallax is a distributed model serving framework for building your own self-hosted AI cluster across scattered GPUs, Macs, and

Mesh LLM splits large open-weight models into layer ranges across your own GPUs and serves them through one OpenAI-compatible endpoint at localhost:9337.

Open-source KV cache layer for LLM inference that skips redundant prefill work

Crusoe Cloud GPU instances, serverless inference, and fine-tuning priced for AI teams that want orchestration included

Self-hosted control plane that turns your own GPUs into OpenAI- and Anthropic-compatible model endpoints

No-code LLM fine-tuning GUI for private, air-gapped model customization — H2O LLM Studio delivers sovereign AI training.

Enterprise LLM fine-tuning with accuracy SLAs and sub-second inference.

Few-shot LLM fine-tuning platform that keeps models updated as new data arrives — private beta, access by email.

Open-source worker client that donates your idle GPU or CPU cycles to the AI Horde so anyone can generate images and text for free.

Open-source BentoML toolkit for packaging and serving diffusion models like Stable Diffusion and Flux as scalable APIs.

Groq delivers fast LLM inference on its own LPU and LPX silicon through an OpenAI-compatible API.

Run and fine-tune image, video, speech and LLM models with one Replicate API call

Managed Ray platform for distributed training, multimodal data curation, batch embedding, and post-training on your own GPUs

Run fast, production-grade GPU inference on dedicated GPUs or token-priced Model APIs — with per-minute billing.

Serverless AI inference on 100+ open models via an OpenAI-compatible API, billed per token with no GPU overhead.

Run open-weight model inference on Together AI — serverless APIs, batch jobs, and GPU clusters.

MAX Engine serves open models through one OpenAI-compatible endpoint across NVIDIA, AMD, Apple silicon, CPUs, and ASICs.

Rent GPUs on Vast.ai's marketplace — 20,000+ cards, per-second billing, and API-native provisioning agents can drive.

Serverless APIs for 200+ open-weight LLM, image, audio, video and vision models, plus GPU cloud and an agent sandbox.

LLaMA-Factory fine-tunes 100+ LLMs and VLMs with a zero-code CLI and the LlamaBoard web UI

Salad Cloud rents idle consumer GPUs from $0.015 per GPU-hour, billed per second, for retryable inference and batch work.

FuriosaAI's RNGD inference accelerators and NXT RNGD Server serve LLMs in 3 kW air-cooled racks via OpenAI-compatible APIs.