CoCA-MDD: A Coupled Cross-Attention based Framework for Streaming Mispronunciation Detection and Diagnosis. (arXiv:2111.08191v2 [cs.CL] UPDATED)

Mispronunciation detection and diagnosis (MDD) is a popular research focus in
computer-aided pronunciation training (CAPT) systems. End-to-end (e2e)
approaches are becoming dominant in MDD. However an e2e MDD model usually
requires entire speech utterances as input context, which leads to significant
time latency especially for long paragraphs. We propose a streaming e2e MDD
model called CoCA-MDD. We utilize conv-transformer structure to encode input
speech in a streaming manner. A coupled cross-attention (CoCA) mechanism is
proposed to integrate frame-level acoustic features …

arxiv attention detection diagnosis framework streaming