Grid Diffusion Models for Text-to-Video Generation

arXiv:2404.00234v1 Announce Type: new
Abstract: Recent advances in the diffusion models have significantly improved text-to-image generation. However, generating videos from text is a more challenging task than generating images from text, due to the much larger dataset and higher computational cost required. Most existing video generation methods use either a 3D U-Net architecture that considers the temporal dimension or autoregressive generation. These methods require large datasets and are limited in terms of computational costs compared to text-to-image generation. To tackle …

abstract advances architecture arxiv computational cost cs.cv dataset diffusion diffusion models grid however image image generation images text text-to-image text-to-video type video video generation videos