Mozilla Report: How Common Crawl’s Data Infrastructure Shaped the Battle Royale over Generative AI

Mozilla investigates Common Crawl’s influence as a backbone for Large Language Models: its shortcomings, benefits, and implications for trustworthy AI

(BERLIN, GERMANY | FEBRUARY 6, 2024) — When OpenAI rolled out its text generator ChatGPT in 2022, few paid attention to the outsized importance of its chief training dataset, Common Craw.

Now, Mozilla’s new study “Training Data for the Price of a Sandwich: Common Crawl’s Impact on Generative AI” shows how Common Crawl laid the infrastructural foundation that shaped today’s …

attention benefits berlin chatgpt data data infrastructure generative generator germany importance influence infrastructure language language models large language large language models mozilla openai report text trustworthy trustworthy ai