Improving Cross-lingual Representation for Semantic Retrieval with Code-switching

arXiv:2403.01364v1 Announce Type: new
Abstract: Semantic Retrieval (SR) has become an indispensable part of the FAQ system in the task-oriented question-answering (QA) dialogue scenario. The demands for a cross-lingual smart-customer-service system for an e-commerce platform or some particular business conditions have been increasing recently. Most previous studies exploit cross-lingual pre-trained models (PTMs) for multi-lingual knowledge retrieval directly, while some others also leverage the continual pre-training before fine-tuning PTMs on the downstream tasks. However, no matter which schema is used, the …

abstract arxiv become business code commerce cross-lingual cs.cl customer dialogue e-commerce exploit faq part platform pre-trained models question representation retrieval semantic service smart studies type