Trinity Detector:text-assisted and attention mechanisms based spectral fusion for diffusion generation image detection

arXiv:2404.17254v1 Announce Type: new
Abstract: Artificial Intelligence Generated Content (AIGC) techniques, represented by text-to-image generation, have led to a malicious use of deep forgeries, raising concerns about the trustworthiness of multimedia content. Adapting traditional forgery detection methods to diffusion models proves challenging. Thus, this paper proposes a forgery detection method explicitly designed for diffusion models called Trinity Detector. Trinity Detector incorporates coarse-grained text features through a CLIP encoder, coherently integrating them with fine-grained artifacts in the pixel domain for comprehensive …

abstract aigc artificial artificial intelligence arxiv attention attention mechanisms concerns cs.cv detection detection methods diffusion diffusion models forgery fusion generated image image detection image generation intelligence multimedia paper text text-to-image type