Beware of Words: Evaluating the Lexical Richness of Conversational Large Language Models

arXiv:2402.15518v1 Announce Type: new
Abstract: The performance of conversational Large Language Models (LLMs) in general, and of ChatGPT in particular, is currently being evaluated on many different tasks, from logical reasoning or maths to answering questions on a myriad of topics. Instead, much less attention is being devoted to the study of the linguistic features of the texts generated by these LLMs. This is surprising since LLMs are models for language, and understanding how they use the language is important. …

abstract arxiv attention chatgpt conversational cs.cl general language language models large language large language models llms maths performance questions reasoning tasks topics type words