Accuracy enhancement method for speech emotion recognition from spectrogram using temporal frequency correlation and positional information learning through knowledge transfer

arXiv:2403.17327v1 Announce Type: cross
Abstract: In this paper, we propose a method to improve the accuracy of speech emotion recognition (SER) by using vision transformer (ViT) to attend to the correlation of frequency (y-axis) with time (x-axis) in spectrogram and transferring positional information between ViT through knowledge transfer. The proposed method has the following originality i) We use vertically segmented patches of log-Mel spectrogram to analyze the correlation of frequencies over time. This type of patch allows us to correlate …

abstract accuracy arxiv correlation cs.cv cs.sd eess.as emotion information knowledge paper recognition spectrogram speech speech emotion temporal through transfer transformer type vision vit