Latency-aware Unified Dynamic Networks for Efficient Image Recognition

arXiv:2308.15949v3 Announce Type: replace
Abstract: Dynamic computation has emerged as a promising avenue to enhance the inference efficiency of deep networks. It allows selective activation of computational units, leading to a reduction in unnecessary computations for each input sample. However, the actual efficiency of these dynamic models can deviate from theoretical predictions. This mismatch arises from: 1) the lack of a unified approach due to fragmented research; 2) the focus on algorithm design over critical scheduling strategies, especially in CUDA-enabled …

arxiv cs.cv dynamic image image recognition latency networks recognition type