Strong Lottery Ticket Hypothesis with $\varepsilon$--perturbation. (arXiv:2210.16589v1 [cs.LG])

The strong Lottery Ticket Hypothesis (LTH) claims the existence of a
subnetwork in a sufficiently large, randomly initialized neural network that
approximates some target neural network without the need of training. We extend
the theoretical guarantee of the strong LTH literature to a scenario more
similar to the original LTH, by generalizing the weight change in the
pre-training step to some perturbation around initialization. In particular, we
focus on the following open questions: By allowing an $\varepsilon$-scale
perturbation on the …

arxiv hypothesis lottery ticket hypothesis