MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answering

arXiv:2404.05590v1 Announce Type: new
Abstract: Large Language Models (LLMs) have the potential of facilitating the development of Artificial Intelligence technology to assist medical experts for interactive decision support, which has been demonstrated by their competitive performances in Medical QA. However, while impressive, the required quality bar for medical applications remains far from being achieved. Currently, LLMs remain challenged by outdated knowledge and by their tendency to generate hallucinated content. Furthermore, most benchmarks to assess medical knowledge lack reference gold explanations …

abstract applications artificial artificial intelligence artificial intelligence technology arxiv benchmarking cs.cl decision decision support development experts however intelligence interactive language language models large language large language models llms medical multilingual performances quality question question answering support technology type