Alternatives to Mlc Llm

Open-source inference framework for 1-bit LLMs on CPU and GPU.

Edge-native multimodal AI for real-world video intelligence.

GPU-agnostic inference framework for deploying open-source GenAI models.

Fine-tune and deploy open-source LLMs without managing infrastructure.

Chinese LLM platform for enterprise agents, MaaS, and open-source models

Managed Ray platform for distributed training and batch inference at scale.

Open-source LLM inference optimization for NVIDIA GPUs

Open-source AI assistant for private offline inference

Open-source AI agent OS for enterprise teams building production-grade autonomous agents.

Sovereign domain-specific SLLMs for European enterprises & government.

LPU-powered sub-200ms inference for real-time AI apps

Low-cost inference API for 100+ models with up to 1M-token context

Run open-source LLMs locally with one command, scale to cloud when needed.