Features
Conversational chat UI with streaming responses
Multiple GPT model selection (GPT-3.5, GPT-4, GPT-4o)
Customizable temperature, max tokens, and top-p parameters
Prompt template library with save/load
Conversation history with search and folders
Token usage tracking and cost estimation
Export conversations as JSON or plain text
API key management for OpenAI
Team collaboration (Pro plan)
Conversation cloning and forking
Fine-tune open-source LLMs (Llama 3, Mistral, Llama 2)
Automated hyperparameter optimization (Ludwig)
One-click deployment with autoscaling
Low-latency inference endpoints
Model evaluation and version comparison
Custom training data from S3/GCS
LoRA/QLoRA adapter-based fine-tuning
Per-request monitoring and logging
VPC deployment for data privacy
Support for multiple model architectures
