Chinese Spelling Correction as Rephrasing Language Model

arXiv:2308.08796v3 Announce Type: replace
Abstract: This paper studies Chinese Spelling Correction (CSC), which aims to detect and correct the potential spelling errors in a given sentence. Current state-of-the-art methods regard CSC as a sequence tagging task and fine-tune BERT-based models on sentence pairs. However, we note a critical flaw in the process of tagging one character to another, that the correction is excessively conditioned on the error. This is opposite from human mindset, where individuals rephrase the complete sentence based …

abstract art arxiv bert chinese cs.cl current errors language language model paper process regard state studies tagging type