Tuning-Free Adaptive Style Incorporation for Structure-Consistent Text-Driven Style Transfer

arXiv:2404.06835v1 Announce Type: new
Abstract: In this work, we target the task of text-driven style transfer in the context of text-to-image (T2I) diffusion models. The main challenge is consistent structure preservation while enabling effective style transfer effects. The past approaches in this field directly concatenate the content and style prompts for a prompt-level style injection, leading to unavoidable structure distortions. In this work, we propose a novel solution to the text-driven style transfer task, namely, Adaptive Style Incorporation~(ASI), to achieve …

abstract arxiv challenge consistent context cs.cv diffusion diffusion models effects enabling free image preservation prompts style style transfer text text-to-image transfer type work