SportQA: A Benchmark for Sports Understanding in Large Language Models

arXiv:2402.15862v1 Announce Type: new
Abstract: A deep understanding of sports, a field rich in strategic and dynamic content, is crucial for advancing Natural Language Processing (NLP). This holds particular significance in the context of evaluating and advancing Large Language Models (LLMs), given the existing gap in specialized benchmarks. To bridge this gap, we introduce SportQA, a novel benchmark specifically designed for evaluating LLMs in the context of sports understanding. SportQA encompasses over 70,000 multiple-choice questions across three distinct difficulty levels, …

abstract arxiv benchmark benchmarks bridge context cs.cl dynamic gap language language models language processing large language large language models llms natural natural language natural language processing nlp processing significance sports type understanding