Dual-Modal Prompting for Sketch-Based Image Retrieval

arXiv:2404.18695v1 Announce Type: new
Abstract: Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories, and ii) fine-grained, referring to intra-category instance-level retrieval. Our key innovation lies in the realization that solely addressing this cross-category and fine-grained recognition task from the generalization perspective may be inadequate since the knowledge accumulated from limited seen categories might not be fully …

abstract aim arxiv challenges cs.cv fine-grained image images innovation instance key lies major modal prompting retrieval sbir sketches study type zero-shot