SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Model

arXiv:2403.10044v1 Announce Type: new
Abstract: Controllable spherical panoramic image generation holds substantial applicative potential across a variety of domains.However, it remains a challenging task due to the inherent spherical distortion and geometry characteristics, resulting in low-quality content generation.In this paper, we introduce a novel framework of SphereDiffusion to address these unique challenges, for better generating high-quality and precisely controllable spherical panoramic images.For the spherical distortion characteristic, we embed the semantics of the distorted object with text encoding, then explicitly construct …

abstract arxiv challenges content generation cs.cv diffusion diffusion model domains framework geometry however image image generation low novel paper quality resilient type