Robust CLIP-Based Detector for Exposing Diffusion Model-Generated Images

arXiv:2404.12908v1 Announce Type: cross
Abstract: Diffusion models (DMs) have revolutionized image generation, producing high-quality images with applications spanning various fields. However, their ability to create hyper-realistic images poses significant challenges in distinguishing between real and synthetic content, raising concerns about digital authenticity and potential misuse in creating deepfakes. This work introduces a robust detection framework that integrates image and text features extracted by CLIP model with a Multilayer Perceptron (MLP) classifier. We propose a novel loss that can improve the …

arxiv clip cs.cv cs.lg diffusion diffusion model eess.iv generated images robust type