How Paralingual are Paralinguistic Representations? A Case Study in Speech Emotion Recognition

Pre-trained Models (PTMs) have facilitated substantial progress in the field of Speech Emotion Recognition (SER). SER is an area with applications ranging from HumanComputer Interaction to Healthcare. Recent studies have leveraged various PTM representations as input features for downstream models for SER. PTM specifically pre-trained for paralinguistic tasks have obtained state-of-the-art (SOTA) performance for SER. However, such PTM haven't been evaluated for SER in multilingual settings and experimented only with English. So, we fill this gap, by performing a comprehensive …

applications case case study cs.cl cs.sd eess.as emotion features healthcare pre-trained models progress recognition speech speech emotion studies study tasks