Improving Speech Emotion Recognition Through Focus and Calibration Attention Mechanisms. (arXiv:2208.10491v1 [cs.SD])

Attention has become one of the most commonly used mechanisms in deep
learning approaches. The attention mechanism can help the system focus more on
the feature space's critical regions. For example, high amplitude regions can
play an important role for Speech Emotion Recognition (SER). In this paper, we
identify misalignments between the attention and the signal amplitude in the
existing multi-head self-attention. To improve the attention area, we propose
to use a Focus-Attention (FA) mechanism and a novel Calibration-Attention (CA) …

arxiv attention attention mechanisms emotion speech