MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions

arXiv:2403.19651v1 Announce Type: new
Abstract: Image retrieval, i.e., finding desired images given a reference image, inherently encompasses rich, multi-faceted search intents that are difficult to capture solely using image-based measures. Recent work leverages text instructions to allow users to more freely express their search intents. However, existing work primarily focuses on image pairs that are visually similar and/or can be characterized by a small set of pre-defined relations. The core thesis of this paper is that text instructions can enable …

abstract arxiv cs.ai cs.cl cs.cv cs.ir cs.mm express however image images reference retrieval search text type work