Deploying Machine Learning Models to Ahead-of-Time Runtime on Edge Using MicroTVM. (arXiv:2304.04842v2 [cs.LG] UPDATED)

In the past few years, more and more AI applications have been applied to
edge devices. However, models trained by data scientists with machine learning
frameworks, such as PyTorch or TensorFlow, can not be seamlessly executed on
edge. In this paper, we develop an end-to-end code generator parsing a
pre-trained model to C source libraries for the backend using MicroTVM, a
machine learning compiler framework extension addressing inference on bare
metal devices. An analysis shows that specific compute-intensive operators can …

ai applications analysis applications arxiv backend code compute data data scientists devices edge edge devices extension framework frameworks generator inference libraries machine machine learning machine learning models operators paper parsing pytorch scientists shows tensorflow