FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs

Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking. FACT-GPT, trained on a synthetic dataset, identifies social media content that aligns with, contradicts, or is irrelevant to previously debunked claims. Our evaluation shows that our specialized LLMs can match the accuracy of larger models in identifying related claims, closely mirroring human judgment. This research provides …

augmentation automate challenge claim cs.cl cs.cy cs.hc cs.si dataset fact-checking gpt health language language models large language large language models llms media misinformation public public health social social media society stage synthetic trust via