Drag Your Noise: Interactive Point-based Editing via Diffusion Semantic Propagation

arXiv:2404.01050v1 Announce Type: cross
Abstract: Point-based interactive editing serves as an essential tool to complement the controllability of existing generative models. A concurrent work, DragDiffusion, updates the diffusion latent map in response to user inputs, causing global latent map alterations. This results in imprecise preservation of the original content and unsuccessful editing due to gradient vanishing. In contrast, we present DragNoise, offering robust and accelerated editing without retracing the latent map. The core rationale of DragNoise lies in utilizing the …

arxiv cs.cv cs.gr cs.hc cs.lg diffusion editing interactive noise propagation semantic type via