Komodo: A Linguistic Expedition into Indonesia's Regional Languages

arXiv:2403.09362v1 Announce Type: new
Abstract: The recent breakthroughs in Large Language Models (LLMs) have mostly focused on languages with easily available and sufficient resources, such as English. However, there remains a significant gap for languages that lack sufficient linguistic resources in the public domain. Our work introduces Komodo-7B, 7-billion-parameter Large Language Models designed to address this gap by seamlessly operating across Indonesian, English, and 11 regional languages in Indonesia. Komodo-7B is a family of LLMs that consist of Komodo-7B-Base and …

abstract arxiv billion cs.cl domain english gap however indonesia language language models languages large language large language models llms public public domain regional resources type work