TNF: Tri-branch Neural Fusion for Multimodal Medical Data Classification

arXiv:2403.01802v1 Announce Type: new
Abstract: This paper presents a Tri-branch Neural Fusion (TNF) approach designed for classifying multimodal medical images and tabular data. It also introduces two solutions to address the challenge of label inconsistency in multimodal classification. Traditional methods in multi-modality medical data classification often rely on single-label approaches, typically merging features from two distinct input modalities. This becomes problematic when features are mutually exclusive or labels differ across modalities, leading to reduced accuracy. To overcome this, our TNF …

abstract arxiv challenge classification cs.cv data data classification fusion images medical medical data multimodal paper solutions tabular tabular data type