BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine

arXiv:2405.00465v1 Announce Type: new
Abstract: Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations. Retrieval-augmented generation provided a solution for these models to update knowledge and enhance their performance. In contrast to previous retrieval-augmented LMs, which utilize specialized cross-attention mechanisms to help LLM encode retrieved text, BiomedRAG adopts a simpler approach by directly inputting the retrieved chunk-based documents …

abstract applications arxiv biomedical biomedicine cs.cl domains hallucinations healthcare however information knowledge language language model language models large language large language model large language models llms performance resources retrieval retrieval-augmented solution type update vital