Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space

arXiv:2404.08923v1 Announce Type: new
Abstract: Multimodal video sentiment analysis aims to integrate multiple modal information to analyze the opinions and attitudes of speakers. Most previous work focuses on exploring the semantic interactions of intra- and inter-modality. However, these works ignore the reliability of multimodality, i.e., modalities tend to contain noise, semantic ambiguity, missing modalities, etc. In addition, previous multimodal approaches treat different modalities equally, largely ignoring their different contributions. Furthermore, existing multimodal sentiment analysis methods directly regress sentiment scores without …

abstract analysis analyze arxiv cs.cv fusion however information interactions modal multimodal multimodality multiple noise opinions ordinal reliability semantic sentiment sentiment analysis space speakers trustworthy type video work