MMIDR: Teaching Large Language Model to Interpret Multimodal Misinformation via Knowledge Distillation

arXiv:2403.14171v1 Announce Type: new
Abstract: Automatic detection of multimodal misinformation has gained a widespread attention recently. However, the potential of powerful Large Language Models (LLMs) for multimodal misinformation detection remains underexplored. Besides, how to teach LLMs to interpret multimodal misinformation in cost-effective and accessible way is still an open question. To address that, we propose MMIDR, a framework designed to teach LLMs in providing fluent and high-quality textual explanations for their decision-making process of multimodal misinformation. To convert multimodal misinformation …

abstract arxiv attention cost cs.cl detection distillation however knowledge language language model language models large language large language model large language models llms misinformation multimodal teaching type via