Features
Pipeline API for inference across 100+ tasks
Trainer with mixed precision, torch.compile, FlashAttention
Fast text generation with generate API (streaming, multiple decoding strategies)
Support for text, computer vision, audio, video, multimodal models
Integration with PyTorch, TensorFlow, and JAX
Parameter-efficient fine-tuning via PEFT integration
Quantization with bitsandbytes
Distributed training with DeepSpeed and FSDP
Model sharing and loading from Hugging Face Hub
Automatic mixed precision training
Official LLM leaderboard and ranking
Battle Mode for side-by-side model comparison
Agent Mode for real-world agent evaluation
Multimodal Max for multimodal model testing
Code Arena with web development challenge categories
BullshitBench for nonsense detection evaluation
File upload for third-party AI processing
Public conversation sharing for community research
Leaderboard dataset publicly available
Monthly arena updates across product and research
Search functionality for models and conversations
Community voting on model responses