EchoReel: Enhancing Action Generation of Existing Video Diffusion Models

arXiv:2403.11535v1 Announce Type: new
Abstract: Recent large-scale video datasets have facilitated the generation of diverse open-domain videos of Video Diffusion Models (VDMs). Nonetheless, the efficacy of VDMs in assimilating complex knowledge from these datasets remains constrained by their inherent scale, leading to suboptimal comprehension and synthesis of numerous actions. In this paper, we introduce EchoReel, a novel approach to augment the capability of VDMs in generating intricate actions by emulating motions from pre-existing videos, which are readily accessible from databases …

abstract arxiv cs.cv datasets diffusion diffusion models diverse domain knowledge scale synthesis type video video diffusion videos