Curriculum Learning Meets Directed Acyclic Graph for Multimodal Emotion Recognition

arXiv:2402.17269v1 Announce Type: new
Abstract: Emotion recognition in conversation (ERC) is a crucial task in natural language processing and affective computing. This paper proposes MultiDAG+CL, a novel approach for Multimodal Emotion Recognition in Conversation (ERC) that employs Directed Acyclic Graph (DAG) to integrate textual, acoustic, and visual features within a unified framework. The model is enhanced by Curriculum Learning (CL) to address challenges related to emotional shifts and data imbalance. Curriculum learning facilitates the learning process by gradually presenting training …

abstract arxiv computing conversation cs.lg curriculum curriculum learning dag emotion features graph language language processing multimodal natural natural language natural language processing novel paper processing recognition textual type visual