all AI news
Measuring Social Norms of Large Language Models
April 4, 2024, 4:42 a.m. | Ye Yuan, Kexin Tang, Jianhao Shen, Ming Zhang, Chenguang Wang
cs.LG updates on arXiv.org arxiv.org
Abstract: We present a new challenge to examine whether large language models understand social norms. In contrast to existing datasets, our dataset requires a fundamental understanding of social norms to solve. Our dataset features the largest set of social norm skills, consisting of 402 skills and 12,383 questions covering a wide set of social norms ranging from opinions and arguments to culture and laws. We design our dataset according to the K-12 curriculum. This enables the …
abstract arxiv challenge contrast cs.ai cs.cl cs.lg dataset datasets features language language models large language large language models measuring norm questions set skills social solve type understanding
More from arxiv.org / cs.LG updates on arXiv.org
Jobs in AI, ML, Big Data
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US