Fast Bayesian Optimization of Needle-in-a-Haystack Problems using Zooming Memory-Based Initialization. (arXiv:2208.13771v1 [cs.LG])

Needle-in-a-Haystack problems exist across a wide range of applications
including rare disease prediction, ecological resource management, fraud
detection, and material property optimization. A Needle-in-a-Haystack problem
arises when there is an extreme imbalance of optimum conditions relative to the
size of the dataset. For example, only 0.82% out of 146k total materials in the
open-access Materials Project database have a negative Poisson's ratio.
However, current state-of-the-art optimization algorithms are not designed with
the capabilities to find solutions to these challenging multidimensional …

arxiv bayesian haystack memory optimization