Dolly: Democratizing LLMs with Open Source (databricks.com)

Summary:

• Dolly is an open-source, cheap-to-build language model with ChatGPT-like instruction following capabilities.
• The model is based on a 6 billion parameter model from EleutherAI and offers businesses a more affordable option for AI solutions.

Key terms:

• Dolly: An open-source large language model that exhibits ChatGPT-like instruction following capabilities and is more affordable for businesses.
• EleutherAI: The organization responsible for the original 6 billion parameter model used in Dolly.
• Alpaca: A model based on LLaMA, tuned on a small dataset to exhibit ChatGPT-like interactivity, and an inspiration for Dolly.
• LLaMA: A set of high-quality language models released by Meta for academic researchers.

Tags:

ChatGPT Research Open Source GPT-3 Artificial Intelligence LLaMA Alpaca Language Model InstructGPT EleutherAI