Pix2Gif: Motion-Guided Diffusion for GIF Generation

arXiv:2403.04634v1 Announce Type: new
Abstract: We present Pix2Gif, a motion-guided diffusion model for image-to-GIF (video) generation. We tackle this problem differently by formulating the task as an image translation problem steered by text and motion magnitude prompts, as shown in teaser fig. To ensure that the model adheres to motion guidance, we propose a new motion-guided warping module to spatially transform the features of the source image conditioned on the two types of prompts. Furthermore, we introduce a perceptual loss …

arxiv cs.ai cs.cv diffusion gif type