Heat Death of Generative Models in Closed-Loop Learning

arXiv:2404.02325v1 Announce Type: new
Abstract: Improvement and adoption of generative machine learning models is rapidly accelerating, as exemplified by the popularity of LLMs (Large Language Models) for text, and diffusion models for image generation.As generative models become widespread, data they generate is incorporated into shared content through the public web. This opens the question of what happens when data generated by a model is fed back to the model in subsequent training campaigns. This is a question about the stability …

abstract adoption arxiv become cs.lg data death diffusion diffusion models generate generative generative models heat image image generation improvement language language models large language large language models llms loop machine machine learning machine learning models public text through type web