DNA Family: Boosting Weight-Sharing NAS with Block-Wise Supervisions

arXiv:2403.01326v1 Announce Type: new
Abstract: Neural Architecture Search (NAS), aiming at automatically designing neural architectures by machines, has been considered a key step toward automatic machine learning. One notable NAS branch is the weight-sharing NAS, which significantly improves search efficiency and allows NAS algorithms to run on ordinary computers. Despite receiving high expectations, this category of methods suffers from low search effectiveness. By employing a generalization boundedness tool, we demonstrate that the devil behind this drawback is the untrustworthy architecture …

arxiv block boosting cs.cv dna family nas type wise