[R] Lumiere: A Space-Time Diffusion Model for Video Generation (Bar-Tal et al., 2024)

**Arxiv:** [https://arxiv.org/abs/2401.12945](https://arxiv.org/abs/2401.12945)

**Abstract:**

"We introduce Lumiere -- a text-to-video diffusion model designed for synthesizing videos that portray realistic, diverse and coherent motion -- a pivotal challenge in video synthesis. To this end, we introduce a Space-Time U-Net architecture that generates the entire temporal duration of the video at once, through a single pass in the model. This is in contrast to existing video models which synthesize distant keyframes followed by temporal super-resolution -- an approach that inherently makes global temporal …

abstract architecture challenge contrast diffusion diffusion model diverse machinelearning pivotal space synthesis temporal text text-to-video through video video diffusion videos