Open Source Conversational LLMs do not know most Spanish words

arXiv:2403.15491v1 Announce Type: new
Abstract: The growing interest in Large Language Models (LLMs) and in particular in conversational models with which users can interact has led to the development of a large number of open-source chat LLMs. These models are evaluated on a wide range of benchmarks to assess their capabilities in answering questions or solving problems on almost any possible topic or to test their ability to reason or interpret texts. Instead, the evaluation of the knowledge that these …

abstract arxiv benchmarks chat conversational cs.cl development language language models large language large language models llms open source spanish type words