StoryImager: A Unified and Efficient Framework for Coherent Story Visualization and Completion

arXiv:2404.05979v1 Announce Type: new
Abstract: Story visualization aims to generate a series of realistic and coherent images based on a storyline. Current models adopt a frame-by-frame architecture by transforming the pre-trained text-to-image model into an auto-regressive manner. Although these models have shown notable progress, there are still three flaws. 1) The unidirectional generation of auto-regressive manner restricts the usability in many scenarios. 2) The additional introduced story history encoders bring an extremely high computational cost. 3) The story visualization and …

arxiv cs.cv framework story type visualization