Towards sustainable technology: “green” approaches to NLP

A comparative study in terms of performance and energy consumption

By Leonardo Rigutini and Samuel Algherini

BERTology

Over the past decade, we have observed an important paradigm shift in the world of NLP. The increasing diffusion of end-to-end approaches has resulted in the development of a wide range of Large Language Models (LLM) based on different neural network architectures and consisting of billions of parameters. Given their huge training costs, these giant models are …

energy-consumption energy efficiency green ai nlp technology