MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devices

arXiv:2403.00830v1 Announce Type: cross
Abstract: Large language models (LLMs) are revolutionizing various domains with their remarkable natural language processing (NLP) abilities. However, deploying LLMs in resource-constrained edge computing and embedded systems presents significant challenges. Another challenge lies in delivering medical assistance in remote areas with limited healthcare facilities and infrastructure. To address this, we introduce MedAide, an on-premise healthcare chatbot. It leverages tiny-LLMs integrated with LangChain, providing efficient edge-based preliminary medical diagnostics and support. MedAide employs model optimizations for minimal …

abstract arxiv challenge challenges computing cs.ai cs.cl devices domains edge edge computing edge devices embedded facilities healthcare language language models language processing large language large language models lies llms medical natural natural language natural language processing nlp on-premise processing remote areas systems type