Don't Look into the Dark: Latent Codes for Pluralistic Image Inpainting

arXiv:2403.18186v1 Announce Type: new
Abstract: We present a method for large-mask pluralistic image inpainting based on the generative framework of discrete latent codes. Our method learns latent priors, discretized as tokens, by only performing computations at the visible locations of the image. This is realized by a restrictive partial encoder that predicts the token label for each visible block, a bidirectional transformer that infers the missing labels by only looking at these tokens, and a dedicated synthesis network that couples …

abstract arxiv cs.cv framework generative image inpainting locations look restrictive tokens type