Answer is All You Need: Instruction-following Text Embedding via Answering the Question

arXiv:2402.09642v1 Announce Type: new
Abstract: This work aims to build a text embedder that can capture characteristics of texts specified by user instructions. Despite its tremendous potential to deploy user-oriented embeddings, none of previous approaches provides a concrete solution for it. This paper offers a new viewpoint, which treats the instruction as a question about the input text and encodes the expected answers to obtain the representation accordingly. Intuitively, texts with the same (implicit) semantics would share similar answers following …

abstract arxiv build concrete cs.cl deploy embedding embeddings paper question solution text text embedding type via work