"Stanford's Affordable Cloning of OpenAI's GPT Sparks Innovation"

Researchers at Stanford's Center for Research on Foundation Models have fine-tuned Meta's LLaMA 7B large language model using OpenAI's GPT API, resulting in the creation of Alpaca AI, which exhibits many behaviors similar to OpenAI's text-davinci-003. The researchers spent less than $500 on OpenAI's API and less than $100 on LLaMA. Alpaca's performance is similar to OpenAI's, but it suffers from several common deficiencies of language models, including hallucination, toxicity, and stereotypes.