CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibility

arXiv:2403.12035v1 Announce Type: new
Abstract: Recent advancements in video generation have been remarkable, yet many existing methods struggle with issues of consistency and poor text-video alignment. Moreover, the field lacks effective techniques for text-guided video inpainting, a stark contrast to the well-explored domain of text-guided image inpainting. To this end, this paper proposes a novel text-guided video inpainting model that achieves better consistency, controllability and compatibility. Specifically, we introduce a simple but efficient motion capture module to preserve motion consistency, …

abstract alignment arxiv contrast cs.cv domain image inpainting struggle text type video video generation