TimeRewind: Rewinding Time with Image-and-Events Video Diffusion

arXiv:2403.13800v1 Announce Type: new
Abstract: This paper addresses the novel challenge of ``rewinding'' time from a single captured image to recover the fleeting moments missed just before the shutter button is pressed. This problem poses a significant challenge in computer vision and computational photography, as it requires predicting plausible pre-capture motion from a single static frame, an inherently ill-posed task due to the high degree of freedom in potential pixel movements. We overcome this challenge by leveraging the emerging technology …

arxiv cs.cv diffusion events image type video video diffusion