TALC: Time-Aligned Captions for Multi-Scene Text-to-Video Generation

arXiv:2405.04682v1 Announce Type: cross
Abstract: Recent advances in diffusion-based generative modeling have led to the development of text-to-video (T2V) models that can generate high-quality videos conditioned on a text prompt. Most of these T2V models often produce single-scene video clips that depict an entity performing a particular action (e.g., `a red panda climbing a tree'). However, it is pertinent to generate multi-scene videos since they are ubiquitous in the real-world (e.g., `a red panda climbing a tree' followed by `the …

arxiv captions cs.ai cs.cv cs.lg text text-to-video type video video generation