[D] Current opinions on the information bottleneck principle for neural networks?

A while back, the IB principle ([https://arxiv.org/abs/1503.02406](https://arxiv.org/abs/1503.02406)) made a few waves as a promising framework to understand/study deep neural networks. But I recall a series of follow up works (notably [https://openreview.net/forum?id=ry\_WPG-A-](https://openreview.net/forum?id=ry_WPG-A-)) that called a lot of the results into question, and (I think?) people drifted away from it.

I saw this recent paper ([https://arxiv.org/abs/2304.09355](https://arxiv.org/abs/2304.09355)) on the IB and self-supervised learning, and it got me wondering what the current views are as to how useful/accurate the IB view of deep learning …

machinelearning