Shadow Generation for Composite Image Using Diffusion model

arXiv:2403.15234v1 Announce Type: new
Abstract: In the realm of image composition, generating realistic shadow for the inserted foreground remains a formidable challenge. Previous works have developed image-to-image translation models which are trained on paired training data. However, they are struggling to generate shadows with accurate shapes and intensities, hindered by data scarcity and inherent task complexity. In this paper, we resort to foundation model with rich prior knowledge of natural shadow images. Specifically, we first adapt ControlNet to our task …

arxiv cs.cv diffusion diffusion model image shadow type