A Survey of Lottery Ticket Hypothesis

arXiv:2403.04861v1 Announce Type: new
Abstract: The Lottery Ticket Hypothesis (LTH) states that a dense neural network model contains a highly sparse subnetwork (i.e., winning tickets) that can achieve even better performance than the original model when trained in isolation. While LTH has been proved both empirically and theoretically in many works, there still are some open issues, such as efficiency and scalability, to be addressed. Also, the lack of open-source frameworks and consensual experimental setting poses a challenge to future …

abstract arxiv cs.lg cs.ne hypothesis lottery ticket hypothesis network neural network performance survey tickets type