PAON: A New Neuron Model using Pad\'e Approximants

arXiv:2403.11791v1 Announce Type: cross
Abstract: Convolutional neural networks (CNN) are built upon the classical McCulloch-Pitts neuron model, which is essentially a linear model, where the nonlinearity is provided by a separate activation function. Several researchers have proposed enhanced neuron models, including quadratic neurons, generalized operational neurons, generative neurons, and super neurons, with stronger nonlinearity than that provided by the pointwise activation function. There has also been a proposal to use Pade approximation as a generalized activation function. In this paper, …

abstract arxiv cnn convolutional neural networks cs.cv eess.iv function generalized generative linear linear model networks neural networks neuron neurons pitts researchers type