Priors in Bayesian Deep Learning: A Review. (arXiv:2105.06868v3 [stat.ML] UPDATED)

While the choice of prior is one of the most critical parts of the Bayesian
inference workflow, recent Bayesian deep learning models have often fallen back
on vague priors, such as standard Gaussians. In this review, we highlight the
importance of prior choices for Bayesian deep learning and present an overview
of different priors that have been proposed for (deep) Gaussian processes,
variational autoencoders, and Bayesian neural networks. We also outline
different methods of learning priors for these models from …

arxiv bayesian bayesian deep learning deep learning learning ml review