Bayesian Optimization Over Iterative Learners with Structured Responses: A Budget-aware Planning Approach. (arXiv:2206.12708v2 [cs.LG] UPDATED)

The rising growth of deep neural networks (DNNs) and datasets in size
motivates the need for efficient solutions for simultaneous model selection and
training. Many methods for hyperparameter optimization (HPO) of iterative
learners including DNNs attempt to solve this problem by querying and learning
a response surface while searching for the optimum of that surface. However,
many of these methods make myopic queries, do not consider prior knowledge
about the response structure, and/or perform biased cost-aware search, all of
which …

arxiv bayesian budget iterative lg optimization planning responses