RED-DOT: Multimodal Fact-checking via Relevant Evidence Detection

arXiv:2311.09939v2 Announce Type: replace-cross
Abstract: Online misinformation is often multimodal in nature, i.e., it is caused by misleading associations between texts and accompanying images. To support the fact-checking process, researchers have been recently developing automatic multimodal methods that gather and analyze external information, evidence, related to the image-text pairs under examination. However, prior works assumed all external information collected from the web to be relevant. In this study, we introduce a "Relevant Evidence Detection" (RED) module to discern whether each …

arxiv cs.cv cs.mm detection evidence fact-checking multimodal type via