Mask-ControlNet: Higher-Quality Image Generation with An Additional Mask Prompt

arXiv:2404.05331v1 Announce Type: new
Abstract: Text-to-image generation has witnessed great progress, especially with the recent advancements in diffusion models. Since texts cannot provide detailed conditions like object appearance, reference images are usually leveraged for the control of objects in the generated images. However, existing methods still suffer limited accuracy when the relationship between the foreground and background is complicated. To address this issue, we develop a framework termed Mask-ControlNet by introducing an additional mask prompt. Specifically, we first employ large …

abstract accuracy arxiv control controlnet cs.cv diffusion diffusion models generated however image image generation images object objects progress prompt quality reference text text-to-image type