Features
Multi-step agent task evaluation
Simulated software company environment
Automated task completion metrics
Support for script-based and interactive agents
Scoring based on goal achievement
Reproducible test scenarios
Logging and trace visualization
Official LLM leaderboard and ranking
Battle Mode for side-by-side model comparison
Agent Mode for real-world agent evaluation
Multimodal Max for multimodal model testing
Code Arena with web development challenge categories
BullshitBench for nonsense detection evaluation
File upload for third-party AI processing
Public conversation sharing for community research
Leaderboard dataset publicly available
Monthly arena updates across product and research
Search functionality for models and conversations
Community voting on model responses
