Assessing The Potential Of Mid-Sized Language Models For Clinical QA

arXiv:2404.15894v1 Announce Type: new
Abstract: Large language models, such as GPT-4 and Med-PaLM, have shown impressive performance on clinical tasks; however, they require access to compute, are closed-source, and cannot be deployed on device. Mid-size models such as BioGPT-large, BioMedLM, LLaMA 2, and Mistral 7B avoid these drawbacks, but their capacity for clinical tasks has been understudied. To help assess their potential for clinical use and help researchers decide which model they should use, we compare their performance on two …

abstract access arxiv clinical compute cs.ai cs.cl gpt gpt-4 however language language models large language large language models llama llama 2 med-palm mistral mistral 7b palm performance tasks type