Alternatives to TensorRT-LLM

Open-source inference framework for 1-bit LLMs on CPU and GPU.

GPU-agnostic inference framework for deploying open-source GenAI models.

Open-source AI assistant for private offline inference

Fine-tune and deploy open-source LLMs without managing infrastructure.

Chinese LLM platform for enterprise agents, MaaS, and open-source models

Open-source AI agent OS for enterprise teams building production-grade autonomous agents.

Run open-source LLMs locally with one command, scale to cloud when needed.

Managed Ray platform for distributed training and batch inference at scale.

LPU-powered sub-200ms inference for real-time AI apps

Low-cost inference API for 100+ models with up to 1M-token context

Edge-native multimodal AI for real-world video intelligence.

Sovereign domain-specific SLLMs for European enterprises & government.