IIDM: Image-to-Image Diffusion Model for Semantic Image Synthesis

arXiv:2403.13378v1 Announce Type: new
Abstract: Semantic image synthesis aims to generate high-quality images given semantic conditions, i.e. segmentation masks and style reference images. Existing methods widely adopt generative adversarial networks (GANs). GANs take all conditional inputs and directly synthesize images in a single forward step. In this paper, semantic image synthesis is treated as an image denoising task and is handled with a novel image-to-image diffusion model (IIDM). Specifically, the style reference is first contaminated with random noise and then …

arxiv cs.cv diffusion diffusion model image image diffusion image-to-image semantic synthesis type