Features
Multi-backend support (OpenAI, Anthropic, Google, local LLMs, and more)
Character creation and management with custom personas
Advanced prompt engineering tools (system prompts, context templates)
Worldbuilding and lorebook management
Customizable UI themes and CSS injection
Plugin and extension system via custom scripts
Roleplaying mode with narration and action parsing
Long-term memory via vector database integration (e.g., ChromaDB)
Group chat and multi-character conversations
Message editing, branching, and regenerating
Token and cost estimation per message
Export/import chat logs in various formats
Quick reply buttons and slash commands
Text-to-speech and speech-to-text integration
Fine-tune open-source LLMs (Llama 3, Mistral, Llama 2)
Automated hyperparameter optimization (Ludwig)
One-click deployment with autoscaling
Low-latency inference endpoints
Model evaluation and version comparison
Custom training data from S3/GCS
LoRA/QLoRA adapter-based fine-tuning
Per-request monitoring and logging
VPC deployment for data privacy
Support for multiple model architectures
