Toward Informal Language Processing: Knowledge of Slang in Large Language Models

arXiv:2404.02323v1 Announce Type: new
Abstract: Recent advancement in large language models (LLMs) has offered a strong potential for natural language systems to process informal language. A representative form of informal language is slang, used commonly in daily conversations and online social media. To date, slang has not been comprehensively evaluated in LLMs due partly to the absence of a carefully designed and publicly accessible benchmark. Using movie subtitles, we construct a dataset that supports evaluation on a diverse set of …

abstract advancement arxiv conversations cs.cl daily form knowledge language language models language processing large language large language models llms media natural natural language process processing slang social social media systems type