TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation

arXiv:2401.12987v2 Announce Type: replace-cross
Abstract: Emotion Recognition in Conversation (ERC) plays a crucial role in enabling dialogue systems to effectively respond to user requests. The emotions in a conversation can be identified by the representations from various modalities, such as audio, visual, and text. However, due to the weak contribution of non-verbal modalities to recognize emotions, multimodal ERC has always been considered a challenging task. In this paper, we propose Teacher-leading Multimodal fusion network for ERC (TelME). TelME incorporates cross-modal …

abstract arxiv audio conversation cs.cl cs.lg cs.sd dialogue eess.as emotion emotions enabling fusion however multimodal network recognition role systems text type visual