Distributed Record Linkage in Healthcare Data with Apache Spark

arXiv:2404.07939v1 Announce Type: cross
Abstract: Healthcare data is a valuable resource for research, analysis, and decision-making in the medical field. However, healthcare data is often fragmented and distributed across various sources, making it challenging to combine and analyze effectively. Record linkage, also known as data matching, is a crucial step in integrating and cleaning healthcare data to ensure data quality and accuracy. Apache Spark, a powerful open-source distributed big data processing framework, provides a robust platform for performing record linkage …

abstract analysis analyze apache apache spark arxiv cs.dc cs.lg data decision distributed healthcare healthcare data however making medical medical field research spark type