Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasets

arXiv:2405.02132v1 Announce Type: cross
Abstract: Large Language Models have demonstrated unparalleled effectiveness in various NLP tasks, and integrating LLMs with automatic speech recognition is becoming a mainstream paradigm. Building upon this momentum, our research delves into an indepth examination of this paradigm on a large opensource Chinese dataset. Specifically, our research aims to evaluate the impact of various configurations of speech encoders, LLMs, and projector modules in the context of the speech foundation encoderLLM ASR paradigm. Furthermore, we introduce a …

abstract arxiv asr automatic speech recognition building chinese cs.cl cs.sd dataset datasets eess.as language language models large language large language models llm llms nlp opensource paradigm recognition research speech speech recognition tasks type