TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis

arXiv:2404.04545v1 Announce Type: cross
Abstract: Multimodal Sentiment Analysis (MSA) endeavors to understand human sentiment by leveraging language, visual, and acoustic modalities. Despite the remarkable performance exhibited by previous MSA approaches, the presence of inherent multimodal heterogeneities poses a challenge, with the contribution of different modalities varying considerably. Past research predominantly focused on improving representation learning techniques and feature fusion strategies. However, many of these efforts overlooked the variation in semantic richness among different modalities, treating each modality uniformly. This approach …

abstract analysis arxiv attention challenge cs.cl cs.mm human language multimodal network performance research sentiment sentiment analysis text type visual