Large Language Models Leverage External Knowledge to Extend Clinical Insight Beyond Language Boundaries

$\textbf{Objectives}$: Large Language Models (LLMs) such as ChatGPT and Med-PaLM have excelled in various medical question-answering tasks. However, these English-centric models encounter challenges in non-English clinical settings, primarily due to limited clinical knowledge in respective languages, a consequence of imbalanced training corpora. We systematically evaluate LLMs in the Chinese medical context and develop a novel in-context learning framework to enhance their performance.
$\textbf{Materials and Methods}$: The latest China National Medical Licensing Examination (CNMLE-2022) served as the benchmark. We collected 53 …

beyond challenges chatgpt clinical cs.ai cs.cl cs.cy english insight knowledge language language models languages large language large language models llms medical med-palm palm question tasks training