The Dangerous Consequences of Generative AI Training on AI-generated Content
Researchers warn that as AI-generated content proliferates around the internet, and AI models begin to train on it, instead of on primarily human-generated content, it causes irreversible defects in the resulting models, leading to "model collapse." This phenomenon occurs when the data AI models generate ends up contaminating the training set for subsequent models, resulting in models gaining a distorted perception of reality. To avoid model collapse, it is important to ensure fair representation of minority groups in datasets and introduce new, clean, human-generated datasets back into their training.