Visual Delta Generator with Large Multi-modal Models for Semi-supervised Composed Image Retrieval

arXiv:2404.15516v1 Announce Type: new
Abstract: Composed Image Retrieval (CIR) is a task that retrieves images similar to a query, based on a provided textual modification. Current techniques rely on supervised learning for CIR models using labeled triplets of the reference image, text, target image. These specific triplets are not as commonly available as simple image-text pairs, limiting the widespread use of CIR and its scalability. On the other hand, zero-shot CIR can be relatively easily trained with image-caption pairs without …

abstract arxiv cs.ai cs.cv current delta generator image images modal multi-modal query reference retrieval semi-supervised supervised learning text textual type visual