Features
Upload PDF, DOCX, TXT, Markdown
Automatic chunking and embedding
Cited answers linking to source documents
REST API for chat, history, and search
Separate knowledge bases with per-project API keys
System prompt and model selection
Retrieval tuning without ML experience
Analytics on queries and citation frequency
Live preview of assistant before integration
One endpoint for retrieval, generation, and citations
Dashboard for managing knowledge bases, documents, and API keys
Conversation management for testing and review
Token streaming for instant feel
Email-based password reset with one-time link
Fine-tune open-source LLMs (Llama 3, Mistral, Llama 2)
Automated hyperparameter optimization (Ludwig)
One-click deployment with autoscaling
Low-latency inference endpoints
Model evaluation and version comparison
Custom training data from S3/GCS
LoRA/QLoRA adapter-based fine-tuning
Per-request monitoring and logging
VPC deployment for data privacy
Support for multiple model architectures