Be Persistent: Towards a Unified Solution for Mitigating Shortcuts in Deep Learning

arXiv:2402.11237v1 Announce Type: new
Abstract: Deep neural networks (DNNs) are vulnerable to shortcut learning: rather than learning the intended task, they tend to draw inconclusive relationships between their inputs and outputs. Shortcut learning is ubiquitous among many failure cases of neural networks, and traces of this phenomenon can be seen in their generalizability issues, domain shift, adversarial vulnerability, and even bias towards majority groups. In this paper, we argue that this commonality in the cause of various DNN issues creates …

abstract arxiv cases cs.cv cs.lg deep learning failure inputs networks neural networks relationships shortcut solution traces type vulnerable