GlossLM: Multilingual Pretraining for Low-Resource Interlinear Glossing

arXiv:2403.06399v1 Announce Type: new
Abstract: A key aspect of language documentation is the creation of annotated text in a format such as interlinear glossed text (IGT), which captures fine-grained morphosyntactic analyses in a morpheme-by-morpheme format. Prior work has explored methods to automatically generate IGT in order to reduce the time cost of language analysis. However, many languages (particularly those requiring preservation) lack sufficient IGT data to train effective models, and crosslingual transfer has been proposed as a method to overcome …

abstract arxiv cost cs.cl documentation fine-grained format generate key language low multilingual pretraining prior reduce text type work