MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion

arXiv:2405.20325v1 Announce Type: new
Abstract: Despite impressive advancements in diffusion-based video editing models in altering video attributes, there has been limited exploration into modifying motion information while preserving the original protagonist's appearance and background. In this paper, we propose MotionFollower, a lightweight score-guided diffusion model for video motion editing. To introduce conditional controls to the denoising process, MotionFollower leverages two of our proposed lightweight signal controllers, one for poses and the other for appearances, both of which consist of convolution …

abstract arxiv attributes cs.cv diffusion diffusion model editing exploration information paper type via video while