Many Hands Make Light Work: Task-Oriented Dialogue System with Module-Based Mixture-of-Experts

arXiv:2405.09744v1 Announce Type: new
Abstract: Task-oriented dialogue systems are broadly used in virtual assistants and other automated services, providing interfaces between users and machines to facilitate specific tasks. Nowadays, task-oriented dialogue systems have greatly benefited from pre-trained language models (PLMs). However, their task-solving performance is constrained by the inherent capacities of PLMs, and scaling these models is expensive and complex as the model size becomes larger. To address these challenges, we propose Soft Mixture-of-Expert Task-Oriented Dialogue system (SMETOD) which leverages …

abstract arxiv assistants automated cs.ai cs.cl dialogue experts however interfaces language language models light machines performance services specific tasks systems tasks type virtual virtual assistants work