On joint training with interfaces for spoken language understanding. (arXiv:2106.15919v3 [cs.CL] UPDATED)

Spoken language understanding (SLU) systems extract both text transcripts and
semantics associated with intents and slots from input speech utterances. SLU
systems usually consist of (1) an automatic speech recognition (ASR) module,
(2) an interface module that exposes relevant outputs from ASR, and (3) a
natural language understanding (NLU) module. Interfaces in SLU systems carry
information on text transcriptions or richer information like neural embeddings
from ASR to NLU. In this paper, we study how interfaces affect joint-training
for spoken …

arxiv interfaces language spoken language understanding training understanding