A Transistor Operations Model for Deep Learning Energy Consumption Scaling Law. (arXiv:2205.15062v2 [cs.LG] UPDATED)

Deep Learning (DL) has transformed the automation of a wide range of
industries and finds increasing ubiquity in society. The high complexity of DL
models and its widespread adoption has led to global energy consumption
doubling every 3-4 months. Currently, the relationship between the DL model
configuration and energy consumption is not well established. At a general
computational energy model level, there is both strong dependency to both the
hardware architecture (e.g. generic processors with different configuration of
inner components- …

arxiv deep learning energy law learning lg operations scaling scaling law