Relightful Harmonization: Lighting-aware Portrait Background Replacement

arXiv:2312.06886v2 Announce Type: replace
Abstract: Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene. Existing harmonization techniques often only focus on adjusting the global color and brightness of the foreground and ignore crucial illumination cues from the background such as apparent lighting direction, leading to unrealistic compositions. We introduce Relightful Harmonization, a lighting-aware diffusion model designed to seamlessly harmonize sophisticated lighting effect for the foreground portrait …

abstract adjusting arxiv color cs.cv focus global lighting replacement type