Data-Augmentation-Based Dialectal Adaptation for LLMs

arXiv:2404.08092v1 Announce Type: new
Abstract: This report presents GMUNLP's participation to the Dialect-Copa shared task at VarDial 2024, which focuses on evaluating the commonsense reasoning capabilities of large language models (LLMs) on South Slavic micro-dialects. The task aims to assess how well LLMs can handle non-standard dialectal varieties, as their performance on standard languages is already well-established. We propose an approach that combines the strengths of different types of language models and leverages data augmentation techniques to improve task performance …

arxiv augmentation cs.ai cs.cl data data-augmentation llms type