Transparent Image Layer Diffusion using Latent Transparency

arXiv:2402.17113v1 Announce Type: new
Abstract: We present LayerDiffusion, an approach enabling large-scale pretrained latent diffusion models to generate transparent images. The method allows generation of single transparent images or of multiple transparent layers. The method learns a "latent transparency" that encodes alpha channel transparency into the latent manifold of a pretrained latent diffusion model. It preserves the production-ready quality of the large diffusion model by regulating the added transparency as a latent offset with minimal changes to the original latent …

abstract alpha arxiv cs.cv cs.gr diffusion diffusion models enabling generate image images latent diffusion models layer manifold multiple scale transparency type