Video Generation with Consistency Tuning

arXiv:2403.06356v1 Announce Type: new
Abstract: Currently, various studies have been exploring generation of long videos. However, the generated frames in these videos often exhibit jitter and noise. Therefore, in order to generate the videos without these noise, we propose a novel framework composed of four modules: separate tuning module, average fusion module, combined tuning module, and inter-frame consistency module. By applying our newly proposed modules subsequently, the consistency of the background and foreground in each video frames is optimized. Besides, …

abstract arxiv cs.ai cs.cv framework fusion generate generated however modules noise novel studies type video video generation videos