BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers

arXiv:2404.18443v1 Announce Type: new
Abstract: Developing effective biomedical retrieval models is important for excelling at knowledge-intensive biomedical tasks but still challenging due to the deficiency of sufficient publicly annotated biomedical data and computational resources. We present BMRetriever, a series of dense retrievers for enhancing biomedical retrieval via unsupervised pre-training on large biomedical corpora, followed by instruction fine-tuning on a combination of labeled datasets and synthetic pairs. Experiments on 5 biomedical tasks across 11 datasets verify BMRetriever's efficacy on various biomedical …

arxiv biomedical cs.ai cs.cl cs.ir language language models large language large language models q-bio.qm text type