ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes

arXiv:2403.05795v1 Announce Type: new
Abstract: The advancement of natural language processing (NLP) systems in healthcare hinges on language model ability to interpret the intricate information contained within clinical notes. This process often requires integrating information from various time points in a patient's medical history. However, most earlier clinical language models were pretrained with a context length limited to roughly one clinical document. In this study, We introduce ClinicalMamba, a specialized version of the Mamba language model, pretrained on a vast …

abstract advancement arxiv clinical cs.cl generative healthcare history however information language language model language models language processing medical natural natural language natural language processing nlp notes patient process processing systems type