SyncTweedies: A General Generative Framework Based on Synchronized Diffusions

arXiv:2403.14370v1 Announce Type: new
Abstract: We introduce a general framework for generating diverse visual content, including ambiguous images, panorama images, mesh textures, and Gaussian splat textures, by synchronizing multiple diffusion processes. We present exhaustive investigation into all possible scenarios for synchronizing multiple diffusion processes through a canonical space and analyze their characteristics across applications. In doing so, we reveal a previously unexplored case: averaging the outputs of Tweedie's formula while conducting denoising in multiple instance spaces. This case also provides …

abstract analyze arxiv canonical cs.cv diffusion diverse framework general generative images investigation mesh multiple panorama processes space through type visual