Your Network May Need to Be Rewritten: Network Adversarial Based on High-Dimensional Function Graph Decomposition

arXiv:2405.03712v1 Announce Type: new
Abstract: In the past, research on a single low dimensional activation function in networks has led to internal covariate shift and gradient deviation problems. A relatively small research area is how to use function combinations to provide property completion for a single activation function application. We propose a network adversarial method to address the aforementioned challenges. This is the first method to use different activation functions in a network. Based on the existing activation functions in …

abstract adversarial arxiv cs.ai cs.lg cs.ne deviation function gradient graph low network networks property research shift small type