TimeGPT : The first Generative Pretrained Transformer for Time-Series Forecasting

In 2023, **Transformers** made **significant breakthroughs** in time-series forecasting.

For example, earlier this year, *Zalando* proved that scaling laws apply in time-series as well. Providing you have large datasets ( And yes, 100,000 time series of M4 are not enough - smallest 7B Llama was trained on 1 trillion tokens! )

Nixtla curated a 100B dataset of time-series and trained TimeGPT, the first foundation model on time-series. The results are unlike anything we have seen so far.

I published the …

apply datasets example forecasting generative large datasets laws llama machinelearningnews scaling series time series tokens transformer transformers zalando