Web: http://arxiv.org/abs/2203.00573

June 17, 2022, 1:12 a.m. | Jacob A. Zavatone-Veth, William L. Tong, Cengiz Pehlevan

stat.ML updates on arXiv.org arxiv.org

Understanding how feature learning affects generalization is among the
foremost goals of modern deep learning theory. Here, we study how the ability
to learn representations affects the generalization performance of a simple
class of models: deep Bayesian linear neural networks trained on unstructured
Gaussian data. By comparing deep random feature models to deep networks in
which all layers are trained, we provide a detailed characterization of the
interplay between width, depth, data density, and prior mismatch. We show that
both …

arxiv bayesian deep features lg linear linear regression random regression

More from arxiv.org / stat.ML updates on arXiv.org

Machine Learning Researcher - Saalfeld Lab

@ Howard Hughes Medical Institute - Chevy Chase, MD | Ashburn, Virginia

Project Director, Machine Learning in US Health

@ ideas42.org | Remote, US

Data Science Intern

@ NannyML | Remote

Machine Learning Engineer NLP/Speech

@ Play.ht | Remote

Research Scientist, 3D Reconstruction

@ Yembo | Remote, US

Clinical Assistant or Associate Professor of Management Science and Systems

@ University at Buffalo | Buffalo, NY