Motion-aware Latent Diffusion Models for Video Frame Interpolation

arXiv:2404.13534v1 Announce Type: new
Abstract: With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring frames plays a crucial role in avoiding motion ambiguity. However, existing VFI methods always struggle to accurately predict the motion information between consecutive frames, and this imprecise estimation leads to blurred and visually incoherent interpolated frames. In this paper, we propose a novel …

abstract advancement aigc arxiv become cs.cv diffusion diffusion models frameworks however interpolation latent diffusion models research role struggle type video video generation