XNLIeu: a dataset for cross-lingual NLI in Basque

arXiv:2404.06996v1 Announce Type: new
Abstract: XNLI is a popular Natural Language Inference (NLI) benchmark widely used to evaluate cross-lingual Natural Language Understanding (NLU) capabilities across languages. In this paper, we expand XNLI to include Basque, a low-resource language that can greatly benefit from transfer-learning approaches. The new dataset, dubbed XNLIeu, has been developed by first machine-translating the English XNLI corpus into Basque, followed by a manual post-edition step. We have conducted a series of experiments using mono- and multilingual LLMs …

abstract arxiv benchmark benefit capabilities cross-lingual cs.ai cs.cl dataset expand inference language languages language understanding low natural natural language nlu paper popular transfer type understanding