Dynamic Modality and View Selection for Multimodal Emotion Recognition with Missing Modalities

arXiv:2404.12251v1 Announce Type: new
Abstract: The study of human emotions, traditionally a cornerstone in fields like psychology and neuroscience, has been profoundly impacted by the advent of artificial intelligence (AI). Multiple channels, such as speech (voice) and facial expressions (image), are crucial in understanding human emotions. However, AI's journey in multimodal emotion recognition (MER) is marked by substantial technical challenges. One significant hurdle is how AI models manage the absence of a particular modality - a frequent occurrence in real-world …

abstract artificial artificial intelligence arxiv channels cs.cv cs.lg cs.sd dynamic eess.as emotion emotions fields however human human emotions image intelligence multimodal multiple neuroscience psychology psychology and neuroscience recognition speech study type understanding view voice