A Deep Dive into Effects of Structural Bias on CMA-ES Performance along Affine Trajectories

arXiv:2404.17323v1 Announce Type: cross
Abstract: To guide the design of better iterative optimisation heuristics, it is imperative to understand how inherent structural biases within algorithm components affect the performance on a wide variety of search landscapes. This study explores the impact of structural bias in the modular Covariance Matrix Adaptation Evolution Strategy (modCMA), focusing on the roles of various modulars within the algorithm. Through an extensive investigation involving 435,456 configurations of modCMA, we identified key modules that significantly influence structural …

abstract algorithm arxiv bias biases cma components cs.ai cs.lg cs.ne deep dive design effects guide heuristics impact iterative optimisation performance search study type