Towards a World-English Language Model for On-Device Virtual Assistants

arXiv:2403.18783v1 Announce Type: new
Abstract: Neural Network Language Models (NNLMs) for Virtual Assistants (VAs) are generally language-, region-, and in some cases, device-dependent, which increases the effort to scale and maintain them. Combining NNLMs for one or more of the categories is one way to improve scalability. In this work, we combine regional variants of English to build a ``World English'' NNLM for on-device VAs. In particular, we investigate the application of adapter bottlenecks to model dialect-specific characteristics in our …

abstract arxiv assistants cases cs.cl english english language language language model language models network neural network scalability scale them type virtual virtual assistants work world