Free Dolly: Introducing the World's First Truly Open Instruction-Tuned LLM

Free Dolly: Introducing the World's First Truly Open Instruction-Tuned LLM

Databricks released a large language model called Dolly a few weeks ago. They just released Dolly 2.0 and it is MUCH more interesting - it's an instruction tuned 12B parameter upgrade of EleutherAI's Pythia model. Unlike other recent instruction tuned models Databricks didn't use a training set derived from GPT-3 - instead, they recruited 5,000 employees to help put together 15,000 human-generated request/response pairs, which they have released under a …

ai attribution creative databricks dolly dolly 2.0 eleutherai employees free generated generativeai gpt gpt-3 homebrewllms human language language model large language model llm llms opensource pythia set training upgrade world