Streamlining Social Media Information Retrieval for COVID-19 Research with Deep Learning

arXiv:2306.16001v3 Announce Type: replace
Abstract: Objective: Social media-based public health research is crucial for epidemic surveillance, but most studies identify relevant corpora with keyword-matching. This study develops a system to streamline the process of curating colloquial medical dictionaries. We demonstrate the pipeline by curating a UMLS-colloquial symptom dictionary from COVID-19-related tweets as proof of concept. Methods: COVID-19-related tweets from February 1, 2020, to April 30, 2022 were used. The pipeline includes three modules: a named entity recognition module to detect …

abstract arxiv covid covid-19 cs.ai cs.cl cs.ir deep learning dictionary epidemic health health research identify information media medical pipeline process public public health research retrieval social social media studies study surveillance type