Dolly
Open-source instruction-following LLM fine-tuned in 30 minutes on one machine.
Dolly is a solid entry point for open-source LLM fine-tuning—easy to train on a single machine and commercially licensed. But its 12B size and 15k training records cap performance, so it's more a learning tool than a production workhorse. Pair it with a larger model if you need accuracy on complex tasks.
- Researchers experimenting with LLM fine-tuning
- Developers building custom instruction-following bots
- Teams needing a commercial-friendly open LLM
- Hobbyists with limited compute for model training
- Production-scale chatbot requiring low latency
- Users needing models larger than 12B parameters
- Teams requiring ongoing model updates or support
We scan live Reddit threads, YouTube comments, X posts, G2 reviews and other communities — and hand you an honest verdict in under a minute.
- Honest verdict, not marketing
- Real pros & cons from real users
- Attributed quotes with receipts
3 free scans · no card needed
In short
Dolly — Open-source instruction-following LLM fine-tuned in 30 minutes on one machine. Best for Researchers experimenting with LLM fine-tuning, Developers building custom instruction-following bots, Teams needing a commercial-friendly open LLM. Free to use.
Viability Score
How likely is Dolly to still be operational in 12 months? Based on 4 signals — momentum (how recently it shipped), wrapper dependency, revenue model, and web presence.
Last calculated: July 2026
How we score →Key Features
- Instruction-following LLM fine-tuned on 15k records
- Based on Pythia-12B (12B parameters)
- Trainable in ~30 minutes on one machine
- Commercially licensed (Apache 2.0)
- Open-source weights and training code
- Covers 7 instruction domains (brainstorming, classification, QA, etc.)
- Supports inference on A100 and A10 GPUs
- Includes training and evaluation pipeline
- Community-generated dataset (databricks-dolly-15k)
- Available on Hugging Face (databricks/dolly-v2-12b)
- Hugging Face Transformers pipeline support
- torch.bfloat16 inference support
About Dolly
Dolly is an open-source, instruction-following large language model developed by Databricks and licensed under Apache 2.0. Based on EleutherAI's Pythia-12B architecture, it is fine-tuned on the databricks-dolly-15k dataset—roughly 15,000 high-quality instruction/response pairs generated by Databricks employees. The training covers seven capability domains from the InstructGPT paper: brainstorming, classification, closed QA, generation, information extraction, open QA, and summarization. One of Dolly's key differentiators is that it can be trained in about 30 minutes on a single machine, making it uniquely accessible for teams with limited compute. The model and training code are available on GitHub and Hugging Face (databricks/dolly-v2-12b). While Dolly is not state-of-the-art, it exhibits surprisingly strong instruction-following behavior for a 12B parameter model. It is best suited for researchers, developers, and hobbyists who want to experiment with fine-tuning or deploy a lightweight, commercially safe LLM for non-critical tasks. Compared to larger proprietary models like GPT-4 or Llama 2, Dolly trades raw accuracy for lower cost, transparency, and ease of customization. It is not intended for production-grade chatbots or complex reasoning tasks.
Behind the Verdict
We'd reach for Dolly when we want to test an instruction-following pipeline without cloud GPU bills. The fact that you can fine-tune the whole model on one machine in 30 minutes is a genuine win for teams with limited hardware. And the Apache 2.0 license means you can use it commercially without fear. That said, Dolly's performance is modest. The model hallucinates, struggles with math and dates, and can't handle complex prompts well. For production use, you'd likely need a larger model like Llama 2 70B or a proprietary API. Where it bites is in scalability: 12B parameters won't run on a laptop—you still need a decent GPU (A10 or A100) for inference. Also, there's no active development; the repo hasn't seen major updates since 2023. If you're after a community-supported, actively evolving open model, consider alternatives like Alpaca or Vicuna. But if you want a straightforward, well-documented example of fine-tuning an LLM on custom instructions, Dolly still holds up. Best for learning and prototyping, not for customer-facing apps.
Researching Dolly? Get your full AI stack in 60 seconds.
Free, no signup — tell us your goal and get tools matched to your budget & existing stack.
Use Cases
- Fine-tune a custom instruction-following model on domain-specific data for internal tools
- Experiment with LLM alignment techniques using a small, fast-to-train base model
- Deploy a chatbot for brainstorming or closed QA on a private dataset
- Teach yourself modern LLM fine-tuning with a fully open-source pipeline
- Create a lightweight assistant for classification or information extraction tasks
Models Under the Hood
as of 2026-07-17
Limitations
- Dolly is based on the Pythia-12B model, which may struggle with complex reasoning and factual accuracy compared to larger models.
- The training dataset (15k records) is relatively small, so the model may not generalize as well as models trained on millions of examples.
- There are no official API, rate limits, or ongoing maintenance by Databricks beyond the initial release.
12-month cost
Project the real annual outlay, including the implied monthly cost when only an annual tier is published.
Vendor list price only. Add-on usage, seat overages, and contract minimums are surfaced under Hidden costs & gotchas.
Integrations
Resources & Guides
Official links
Tools that pair well with Dolly
Common stack mates teams adopt alongside Dolly, with the specific reason each pairing earns its keep.
Featured Head-to-Head Comparisons
Alternatives to Dolly
View allPerplexity
AI answer engine with real-time cited research and autonomous task execution
Popular in Research & Education
Reach Best
AI-powered college matching and admission chance prediction for high school students.
Frequently Asked Questions
Categories
Best-of guides
Used Dolly? Help shape our editorial sentiment research.