DeS3: Adaptive Attention-driven Self and Soft Shadow Removal using ViT Similarity

arXiv:2211.08089v4 Announce Type: replace
Abstract: Removing soft and self shadows that lack clear boundaries from a single image is still challenging. Self shadows are shadows that are cast on the object itself. Most existing methods rely on binary shadow masks, without considering the ambiguous boundaries of soft and self shadows. In this paper, we present DeS3, a method that removes hard, soft and self shadows based on adaptive attention and ViT similarity. Our novel ViT similarity loss utilizes features extracted …

arxiv attention cs.cv shadow type vit