SD-NAE: Generating Natural Adversarial Examples with Stable Diffusion

arXiv:2311.12981v2 Announce Type: replace
Abstract: Natural Adversarial Examples (NAEs), images arising naturally from the environment and capable of deceiving classifiers, are instrumental in robustly evaluating and identifying vulnerabilities in trained models. In this work, unlike prior works that passively collect NAEs from real images, we propose to actively synthesize NAEs using the state-of-the-art Stable Diffusion. Specifically, our method formulates a controlled optimization process, where we perturb the token embedding that corresponds to a specified class to generate NAEs. This generation …

adversarial adversarial examples arxiv cs.cv diffusion examples natural stable diffusion type