Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and Sundanese

arXiv:2402.17302v1 Announce Type: new
Abstract: Large Language Models (LLMs) are increasingly being used to generate synthetic data for training and evaluating models. However, it is unclear whether they can generate a good quality of question answering (QA) dataset that incorporates knowledge and cultural nuance embedded in a language, especially for low-resource languages. In this study, we investigate the effectiveness of using LLMs in generating culturally relevant commonsense QA datasets for Indonesian and Sundanese languages. To do so, we create datasets …

abstract arxiv case case study cs.cl data dataset embedded generate good knowledge language language models large language large language models llm llms nuance quality question question answering study synthetic synthetic data training type