Modality Prompts for Arbitrary Modality Salient Object Detection

arXiv:2405.03351v1 Announce Type: new
Abstract: This paper delves into the task of arbitrary modality salient object detection (AM SOD), aiming to detect salient objects from arbitrary modalities, eg RGB images, RGB-D images, and RGB-D-T images. A novel modality-adaptive Transformer (MAT) will be proposed to investigate two fundamental challenges of AM SOD, ie more diverse modality discrepancies caused by varying modality types that need to be processed, and dynamic fusion design caused by an uncertain number of modalities present in the …

abstract arxiv challenges cs.cv detection fundamental images novel object objects paper prompts rgb-d transformer type will