Energy Consumption of Neural Networks on NVIDIA Edge Boards: an Empirical Model. (arXiv:2210.01625v1 [cs.LG])

Recently, there has been a trend of shifting the execution of deep learning
inference tasks toward the edge of the network, closer to the user, to reduce
latency and preserve data privacy. At the same time, growing interest is being
devoted to the energetic sustainability of machine learning. At the
intersection of these trends, we hence find the energetic characterization of
machine learning at the edge, which is attracting increasing attention.
Unfortunately, calculating the energy consumption of a given neural …

arxiv boards edge energy networks neural networks nvidia