Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos

arXiv:2403.13044v1 Announce Type: new
Abstract: We propose a generative model that, given a coarsely edited image, synthesizes a photorealistic output that follows the prescribed layout. Our method transfers fine details from the original image and preserves the identity of its parts. Yet, it adapts it to the lighting and context defined by the new layout. Our key insight is that videos are a powerful source of supervision for this task: objects and camera motions provide many observations of how the …

abstract arxiv context cs.cv dynamic editing generative identity image lighting magic photo photorealistic type videos