The Dangers of AI Learning from AI: Model Collapse and Black Box Generative AI.
Researchers from the UK and Canada have found that using AI-generated content to train AI models causes irreversible defects in the resulting models, leading to a degenerative process called model collapse. As AI-generated content proliferates, models that learn from it perform worse over time, producing more errors and less non-erroneous variety in their responses. This will make it harder to train newer models by scraping the web, giving an advantage to firms which already have access to human interfaces at scale.
