On Cyclical MCMC Sampling

arXiv:2403.00230v1 Announce Type: cross
Abstract: Cyclical MCMC is a novel MCMC framework recently proposed by Zhang et al. (2019) to address the challenge posed by high-dimensional multimodal posterior distributions like those arising in deep learning. The algorithm works by generating a nonhomogeneous Markov chain that tracks -- cyclically in time -- tempered versions of the target distribution. We show in this work that cyclical MCMC converges to the desired probability distribution in settings where the Markov kernels used are fast …

abstract algorithm arxiv challenge deep learning framework markov mcmc multimodal novel posterior sampling stat.co stat.ml the algorithm type versions