Are We Running Out of Training Data?

I was catching up with the new AI Index Report from Stanford’s Human-Centered Artificial Intelligence Institute when one section caught my eye. That was a forecast that we’ll likely run out of high-quality language data needed for train AI models sometime this year.

That’s a worrying timeline. So far, AI companies have improved their large language models by training them on lots of data combined with increasingly more computing power (a strategy otherwise known as the “scaling laws”). If the …

ai companies ai index report ai models artificial artificial intelligence companies data forecast human index institute intelligence language language data quality report running stanford timeline train train ai training training data