VC Theoretical Explanation of Double Descent. (arXiv:2205.15549v3 [stat.ML] UPDATED)

There has been growing interest in generalization performance of large
multilayer neural networks that can be trained to achieve zero training error,
while generalizing well on test data. This regime is known as 'second descent'
and it appears to contradict the conventional view that optimal model
complexity should reflect an optimal balance between underfitting and
overfitting, i.e., the bias-variance trade-off. This paper presents a
VC-theoretical analysis of double descent and shows that it can be fully
explained by classical VC-generalization …

arxiv