"Databricks Advances Open Source AI with New Releases and Free Data"
Databricks has released Dolly 2.0, an open-source, instruction-following LLM fine-tuned on a transparent and freely available dataset that is also open-sourced to use for commercial purposes. Databricks also released the dataset on which Dolly 2.0 was fine-tuned on, called databricks-dolly-15k. Dolly 2.0 is a 12 billion-parameter language model based on the open-source Eleuther AI pythia model family and fine-tuned exclusively on a small, open-source corpus of instruction records generated by Databricks employees.