Spherical Linear Interpolation and Text-Anchoring for Zero-shot Composed Image Retrieval

arXiv:2405.00571v1 Announce Type: new
Abstract: Composed Image Retrieval (CIR) is a complex task that retrieves images using a query, which is configured with an image and a caption that describes desired modifications to that image. Supervised CIR approaches have shown strong performance, but their reliance on expensive manually-annotated datasets restricts their scalability and broader applicability. To address these issues, previous studies have proposed pseudo-word token-based Zero-Shot CIR (ZS-CIR) methods, which utilize a projection module to map images to word tokens. …

abstract arxiv cs.ai cs.cv datasets image images interpolation linear performance query reliance retrieval text type zero-shot