Deep Oscillatory Neural Network

arXiv:2405.03725v1 Announce Type: cross
Abstract: We propose a novel, brain-inspired deep neural network model known as the Deep Oscillatory Neural Network (DONN). Deep neural networks like the Recurrent Neural Networks indeed possess sequence processing capabilities but the internal states of the network are not designed to exhibit brain-like oscillatory activity. With this motivation, the DONN is designed to have oscillatory internal dynamics. Neurons of the DONN are either nonlinear neural oscillators or traditional neurons with sigmoidal or ReLU activation. The …

abstract arxiv brain brain-inspired capabilities cs.ai cs.lg cs.ne deep neural network indeed motivation network networks neural network neural networks novel processing recurrent neural networks type