I3: Intent-Introspective Retrieval Conditioned on Instructions

arXiv:2308.10025v2 Announce Type: replace
Abstract: Recent studies indicate that dense retrieval models struggle to perform well on a wide variety of retrieval tasks that lack dedicated training data, as different retrieval tasks often entail distinct search intents. To address this challenge, in this work we leverage instructions to flexibly describe retrieval intents and introduce I3, a unified retrieval system that performs Intent-Introspective retrieval across various tasks, conditioned on Instructions without any task-specific training. I3 innovatively incorporates a pluggable introspector in …

abstract arxiv challenge cs.cl data retrieval search struggle studies tasks training training data type work