Automated Virtual Product Placement and Assessment in Images using Diffusion Models

arXiv:2405.01130v1 Announce Type: new
Abstract: In Virtual Product Placement (VPP) applications, the discrete integration of specific brand products into images or videos has emerged as a challenging yet important task. This paper introduces a novel three-stage fully automated VPP system. In the first stage, a language-guided image segmentation model identifies optimal regions within images for product inpainting. In the second stage, Stable Diffusion (SD), fine-tuned with a few example product images, is used to inpaint the product into the previously …

abstract applications arxiv assessment automated brand cs.cv diffusion diffusion models image images integration language novel paper placement product product placement products segmentation stage type videos virtual