Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs

arXiv:2305.03935v4 Announce Type: replace
Abstract: Diffusion models have exhibited excellent performance in various domains. The probability flow ordinary differential equation (ODE) of diffusion models (i.e., diffusion ODEs) is a particular case of continuous normalizing flows (CNFs), which enables deterministic inference and exact likelihood evaluation. However, the likelihood estimation results by diffusion ODEs are still far from those of the state-of-the-art likelihood-based generative models. In this work, we propose several improved techniques for maximum likelihood estimation for diffusion ODEs, including both …

arxiv cs.lg diffusion likelihood maximum likelihood estimation type