all AI news
Soundini: Sound-Guided Diffusion for Natural Video Editing. (arXiv:2304.06818v1 [cs.CV])
cs.CV updates on arXiv.org arxiv.org
We propose a method for adding sound-guided visual effects to specific
regions of videos with a zero-shot setting. Animating the appearance of the
visual effect is challenging because each frame of the edited video should have
visual changes while maintaining temporal consistency. Moreover, existing video
editing solutions focus on temporal consistency across frames, ignoring the
visual style variations over time, e.g., thunderstorm, wave, fire crackling. To
overcome this limitation, we utilize temporal sound features for the dynamic
style. Specifically, we …
arxiv audio denoising diffusion editing effects features focus guide natural representation solutions sound temporal video videos visual effects