Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models and Vision Language Models

arXiv:2404.18746v1 Announce Type: cross
Abstract: Image search stands as a pivotal task in multimedia and computer vision, finding applications across diverse domains, ranging from internet search to medical diagnostics. Conventional image search systems operate by accepting textual or visual queries, retrieving the top-relevant candidate results from the database. However, prevalent methods often rely on single-turn procedures, introducing potential inaccuracies and limited recall. These methods also face the challenges, such as vocabulary mismatch and the semantic gap, constraining their overall effectiveness. …

abstract applications arxiv computer computer vision cs.cv cs.mm diagnostics diverse domains image image search interactive internet language language models large language large language models medical multimedia pivotal queries query results retrieval search systems textual type vision visual