Towards a More Inclusive AI: Progress and Perspectives in Large Language Model Training for the S\'ami Language

arXiv:2405.05777v1 Announce Type: new
Abstract: S\'ami, an indigenous language group comprising multiple languages, faces digital marginalization due to the limited availability of data and sophisticated language models designed for its linguistic intricacies. This work focuses on increasing technological participation for the S\'ami language. We draw the attention of the ML community towards the language modeling problem of Ultra Low Resource (ULR) languages. ULR languages are those for which the amount of available textual resources is very low, and the speaker …

abstract arxiv availability cs.ai cs.cl data digital language language model language models language model training languages large language large language model multiple perspectives progress training type work