Concept Weaver: Enabling Multi-Concept Fusion in Text-to-Image Models

arXiv:2404.03913v1 Announce Type: cross
Abstract: While there has been significant progress in customizing text-to-image generation models, generating images that combine multiple personalized concepts remains challenging. In this work, we introduce Concept Weaver, a method for composing customized text-to-image diffusion models at inference time. Specifically, the method breaks the process into two steps: creating a template image aligned with the semantics of input prompts, and then personalizing the template using a concept fusion strategy. The fusion strategy incorporates the appearance of …

abstract arxiv concept concepts cs.ai cs.cv cs.lg diffusion diffusion models enabling fusion image image diffusion image generation image generation models images inference multiple personalized process progress text text-to-image type work