Mai Ho'om\=auna i ka 'Ai: Language Models Improve Automatic Speech Recognition in Hawaiian

arXiv:2404.03073v1 Announce Type: cross
Abstract: In this paper we address the challenge of improving Automatic Speech Recognition (ASR) for a low-resource language, Hawaiian, by incorporating large amounts of independent text data into an ASR foundation model, Whisper. To do this, we train an external language model (LM) on ~1.5M words of Hawaiian text. We then use the LM to rescore Whisper and compute word error rates (WERs) on a manually curated test set of labeled Hawaiian data. As a baseline, …

abstract arxiv asr automatic speech recognition challenge cs.cl cs.lg cs.sd data eess.as foundation foundation model improving independent language language model language models low paper recognition speech speech recognition text train type whisper