On Latency Predictors for Neural Architecture Search

arXiv:2403.02446v1 Announce Type: new
Abstract: Efficient deployment of neural networks (NN) requires the co-optimization of accuracy and latency. For example, hardware-aware neural architecture search has been used to automatically find NN architectures that satisfy a latency constraint on a specific hardware device. Central to these search algorithms is a prediction model that is designed to provide a hardware latency estimate for a candidate NN architecture. Recent research has shown that the sample efficiency of these predictive models can be greatly …

architecture arxiv cs.ar cs.cv cs.lg cs.pf latency neural architecture search search type