Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

arXiv:2404.06138v1 Announce Type: new
Abstract: Large language models (LLMs) show remarkable human-like capability in various domains and languages. However, a notable quality gap arises in low-resource languages, e.g., Indonesian indigenous languages, rendering them ineffective and inefficient in such linguistic contexts. To bridge this quality gap, we introduce Cendol, a collection of Indonesian LLMs encompassing both decoder-only and encoder-decoder architectures across a range of model sizes. We highlight Cendol's effectiveness across a diverse array of tasks, attaining 20% improvement, and demonstrate …

abstract arxiv bridge capability collection cs.cl domains gap generative however human human-like instruction-tuned language language models languages large language large language models llms low quality rendering show them type