You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrieval

arXiv:2403.07222v2 Announce Type: replace
Abstract: Two primary input modalities prevail in image retrieval: sketch and text. While text is widely used for inter-category retrieval tasks, sketches have been established as the sole preferred modality for fine-grained image retrieval due to their ability to capture intricate visual details. In this paper, we question the reliance on sketches alone for fine-grained image retrieval by simultaneously exploring the fine-grained representation capabilities of both sketch and text, orchestrating a duet between the two. The …

abstract arxiv cs.cv fine-grained image retrieval sketches tasks text type visual