BiMediX: Bilingual Medical Mixture of Experts LLM

arXiv:2402.13253v1 Announce Type: new
Abstract: In this paper, we introduce BiMediX, the first bilingual medical mixture of experts LLM designed for seamless interaction in both English and Arabic. Our model facilitates a wide range of medical interactions in English and Arabic, including multi-turn chats to inquire about additional details such as patient symptoms and medical history, multiple-choice question answering, and open-ended question answering. We propose a semi-automated English-to-Arabic translation pipeline with human refinement to ensure high-quality translations. We also introduce …

arxiv bilingual cs.cl experts llm medical mixture of experts type