A neural prosody encoder for end-ro-end dialogue act classification. (arXiv:2205.05590v1 [cs.CL])

Web: http://arxiv.org/abs/2205.05590

Dialogue act classification (DAC) is a critical task for spoken language
understanding in dialogue systems. Prosodic features such as energy and pitch
have been shown to be useful for DAC. Despite their importance, little research
has explored neural approaches to integrate prosodic features into end-to-end
(E2E) DAC models which infer dialogue acts directly from audio signals. In this
work, we propose an E2E neural architecture that takes into account the need
for characterizing prosodic phenomena co-occurring at different levels inside …

arxiv classification encoder neural