Tuning-Free Noise Rectification for High Fidelity Image-to-Video Generation

arXiv:2403.02827v1 Announce Type: new
Abstract: Image-to-video (I2V) generation tasks always suffer from keeping high fidelity in the open domains. Traditional image animation techniques primarily focus on specific domains such as faces or human poses, making them difficult to generalize to open domains. Several recent I2V frameworks based on diffusion models can generate dynamic content for open domain images but fail to maintain fidelity. We found that two main factors of low fidelity are the loss of image details and the …

arxiv cs.cv fidelity free image image-to-video noise type video video generation