Towards Context-Stable and Visual-Consistent Image Inpainting

arXiv:2312.04831v2 Announce Type: replace
Abstract: Recent progress in inpainting increasingly relies on generative models, leveraging their strong generation capabilities for addressing large irregular masks. However, this enhanced generation often introduces context-instability, leading to arbitrary object generation within masked regions. This paper proposes a balanced solution, emphasizing the importance of unmasked regions in guiding inpainting while preserving generation capacity. Our approach, Aligned Stable Inpainting with UnKnown Areas Prior (ASUKA), employs a Masked Auto-Encoder (MAE) to produce reconstruction-based prior. Aligned with the …

abstract arxiv capabilities consistent context cs.cv generative generative models however image importance inpainting masks object paper progress solution type visual