The Rise of Open Source AI: Threatening Tech Titans and Exposing AI's Flaws.

Open source developers may win the generative AI market battle, as recent progress in the community has made Generative AI within reach of any AI-savvy developer. The recent leak of Meta's Large Language Model Meta AI model (LLaMA) spurred an avalanche of innovation from the open source community, with enhancements such as instruction tuning, quantization, quality improvements, and others developed in quick succession. The use of a cheap fine-tuning mechanism known as low-rank adaptation (LoRA) has reduced the barrier to entry for training and experimentation significantly, enabling individuals to personalize a language model in a few hours on consumer hardware. The rapid innovation, combined with the lack of usage restrictions, makes open source AI models an attractive alternative for many users.
Reading Insights
0
0
3 min
vs 4 min read
82%
665 → 121 words
Want the full story? Read the original article
Read on The New Stack