Web: http://arxiv.org/abs/2201.12198

Jan. 31, 2022, 2:11 a.m. | Leyang Zhang, Zhi-Qin John Xu, Tao Luo, Yaoyu Zhang

cs.LG updates on arXiv.org arxiv.org

In recent years, understanding the implicit regularization of neural networks
(NNs) has become a central task of deep learning theory. However, implicit
regularization is in itself not completely defined and well understood. In this
work, we make an attempt to mathematically define and study the implicit
regularization. Importantly, we explore the limitation of a common approach of
characterizing the implicit regularization by data-independent functions. We
propose two dynamical mechanisms, i.e., Two-point and One-point Overlapping
mechanisms, based on which we provide …

arxiv data independent

More from arxiv.org / cs.LG updates on arXiv.org

Senior Data Analyst

@ Fanatics Inc | Remote - New York

Data Engineer - Search

@ Cytora | United Kingdom - Remote

Product Manager, Technical - Data Infrastructure and Streaming

@ Nubank | Berlin

Postdoctoral Fellow: ML for autonomous materials discovery

@ Lawrence Berkeley National Lab | Berkeley, CA

Principal Data Scientist

@ Zuora | Remote

Data Engineer

@ Veeva Systems | Pennsylvania - Fort Washington