AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search

arXiv:2403.19232v1 Announce Type: cross
Abstract: Training-free network architecture search (NAS) aims to discover high-performing networks with zero-cost proxies, capturing network characteristics related to the final performance. However, network rankings estimated by previous training-free NAS methods have shown weak correlations with the performance. To address this issue, we propose AZ-NAS, a novel approach that leverages the ensemble of various zero-cost proxies to enhance the correlation between a predicted ranking of networks and the ground truth substantially in terms of the performance. …

abstract architecture arxiv correlations cost cs.cv cs.lg free however issue nas network network architecture networks novel performance proxies rankings search training type