Towards Measuring and Modeling "Culture" in LLMs: A Survey

arXiv:2403.15412v1 Announce Type: cross
Abstract: We present a survey of 39 recent papers that aim to study cultural representation and inclusion in large language models. We observe that none of the studies define "culture," which is a complex, multifaceted concept; instead, they probe the models on some specially designed datasets which represent certain aspects of "culture." We call these aspects the proxies of cultures, and organize them across three dimensions of demographic, semantic and linguistic-cultural interaction proxies. We also categorize …

abstract aim arxiv concept cs.ai cs.cl cs.cy culture datasets inclusion language language models large language large language models llms measuring modeling observe papers probe representation studies study survey type