Predicated Diffusion: Predicate Logic-Based Attention Guidance for Text-to-Image Diffusion Models

arXiv:2311.16117v2 Announce Type: replace
Abstract: Diffusion models have achieved remarkable results in generating high-quality, diverse, and creative images. However, when it comes to text-based image generation, they often fail to capture the intended meaning presented in the text. For instance, a specified object may not be generated, an unnecessary object may be generated, and an adjective may alter objects it was not intended to modify. Moreover, we found that relationships indicating possession between objects are often overlooked. While users' intentions …

abstract arxiv attention creative cs.cv diffusion diffusion models diverse generated guidance however image image diffusion image generation images instance logic meaning object quality results text text-to-image type