Global-Liar: Factuality of LLMs over Time and Geographic Regions

The increasing reliance on AI-driven solutions, particularly Large Language Models (LLMs) like the GPT series, for information retrieval highlights the critical need for their factuality and fairness, especially amidst the rampant spread of misinformation and disinformation online. Our study evaluates the factual accuracy, stability, and biases in widely adopted GPT models, including GPT-3.5 and GPT-4, contributing to reliability and integrity of AI-mediated information dissemination.
We introduce 'Global-Liar,' a dataset uniquely balanced in terms of geographic and temporal representation, facilitating a …

accuracy biases cs.ai cs.cl cs.ir disinformation fairness global gpt gpt models highlights information language language models large language large language models llms misinformation reliance retrieval series solutions stability study