Compass: Large Multilingual Language Model for South-east Asia

arXiv:2404.09220v1 Announce Type: new
Abstract: Large language models have exhibited significant proficiency in languages endowed with extensive linguistic resources, such as English and Chinese. Nevertheless, their effectiveness notably diminishes when applied to languages characterized by limited linguistic resources, particularly within the Southeast Asian linguistic landscape, such as Indonesian. The scarcity of linguistic resources for these languages presents challenges associated with inadequate training, restricted vocabulary coverage, and challenging evaluation processes. In response to these exigencies, we have introduced CompassLLM, a large …

abstract arxiv asia asian chinese compass cs.cl east english landscape language language model language models languages large language large language models multilingual multilingual language model resources type