Are ChatBots their own death? | Training on Generated Data Makes Models Forget – Paper explained

If LLMs flood the Internet with content over the next years, they will likely sign their own death certificate.
How likely is it that this happens and why is training on AI content so bad?

Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏
Dres. Trost GbR, Siltax, Edvard Grødem, Vignesh Valliappan, Mutual Information, Mike Ton

📜 "Model Dementia: Generated Data Makes Models Forget." Shumailov, Ilia, Zakhar Shumaylov, Yiren Zhao, Yarin Gal, Nicolas Papernot, and Ross …

chatbots data death explained generated internet llms next paper support training