Priors for Deep Networks: Limit theorems, pitfalls, open questions
1,542 views · Published 20 April 2018 · 21:28 · Indexed 28 October 2026
Channel: Microsoft Research · 2018 · Science & Technology
Much research in Bayesian Deep Learning is about approximating the posterior. With some notable exceptions, the choice of prior is less often considered. In this second direction, we discuss recent work on central limit theorems for neural networks with more than one hidden layer, some thoughts about over-confident extrapolation, and the dangers of improper priors from the literature. See more at https://www.microsoft.com/en-us/research/video/priors-deep-networks-limit-theorems-pitfalls-open-questions/