Web: http://arxiv.org/abs/2205.04650

May 11, 2022, 1:11 a.m. | Valentin Frank Ingmar Guenter, Athanasios Sideris

cs.LG updates on arXiv.org arxiv.org

We propose a simultaneous learning and pruning algorithm capable of
identifying and eliminating irrelevant structures in a neural network during
the early stages of training. Thus, the computational cost of subsequent
training iterations, besides that of inference, is considerably reduced. Our
method, based on variational inference principles, learns the posterior
distribution of Bernoulli random variables multiplying the units/filters
similarly to adaptive dropout. We derive a novel hyper-prior distribution over
the prior parameters that is crucial for their optimal selection in …

arxiv deep learning networks neural neural networks

More from arxiv.org / cs.LG updates on arXiv.org

Data Analyst, Patagonia Action Works

@ Patagonia | Remote

Data & Insights Strategy & Innovation General Manager

@ Chevron Services Company, a division of Chevron U.S.A Inc. | Houston, TX

Faculty members in Research areas such as Bayesian and Spatial Statistics; Data Privacy and Security; AI/ML; NLP; Image and Video Data Analysis

@ Ahmedabad University | Ahmedabad, India

Director, Applied Mathematics & Computational Research Division

@ Lawrence Berkeley National Lab | Berkeley, Ca

Business Data Analyst

@ MainStreet Family Care | Birmingham, AL

Assistant/Associate Professor of the Practice in Business Analytics

@ Georgetown University McDonough School of Business | Washington DC