Is ReLU Adversarially Robust?

arXiv:2405.03777v1 Announce Type: new
Abstract: The efficacy of deep learning models has been called into question by the presence of adversarial examples. Addressing the vulnerability of deep learning models to adversarial examples is crucial for ensuring their continued development and deployment. In this work, we focus on the role of rectified linear unit (ReLU) activation functions in the generation of adversarial examples. ReLU functions are commonly used in deep learning models because they facilitate the training process. However, our empirical …

abstract adversarial adversarial examples arxiv cs.ai cs.lg deep learning deployment development examples focus functions linear question relu robust role type vulnerability work