A SOM-based Gradient-Free Deep Learning Method with Convergence Analysis. (arXiv:2101.05612v2 [cs.LG] UPDATED)

Web: http://arxiv.org/abs/2101.05612

As gradient descent method in deep learning causes a series of questions,
this paper proposes a novel gradient-free deep learning structure. By adding a
new module into traditional Self-Organizing Map and introducing residual into
the map, a Deep Valued Self-Organizing Map network is constructed. And analysis
about the convergence performance of such a deep Valued Self-Organizing Map
network is proved in this paper, which gives an inequality about the designed
parameters with the dimension of inputs and the loss of …

analysis arxiv deep deep learning gradient learning