Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction

arXiv:2304.06819v2 Announce Type: replace
Abstract: Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of these data: WSIs represent a very high-dimensional spatial description of a tumor, while bulk transcriptomics represent a global description of gene expression levels within that tumor. In this context, our work aims to address two key challenges: (1) how can we tokenize transcriptomics in …

arxiv cs.ai cs.cv interactions modeling multimodal prediction q-bio.gn q-bio.qm q-bio.to survival type