SmartControl: Enhancing ControlNet for Handling Rough Visual Conditions

arXiv:2404.06451v1 Announce Type: new
Abstract: Human visual imagination usually begins with analogies or rough sketches. For example, given an image with a girl playing guitar before a building, one may analogously imagine how it seems like if Iron Man playing guitar before Pyramid in Egypt. Nonetheless, visual condition may not be precisely aligned with the imaginary result indicated by text prompt, and existing layout-controllable text-to-image (T2I) generation models is prone to producing degraded generated results with obvious artifacts. To address …

arxiv controlnet cs.cv type visual