Pruning vs Quantization: Which is Better?

arXiv:2307.02973v2 Announce Type: replace
Abstract: Neural network pruning and quantization techniques are almost as old as neural networks themselves. However, to date only ad-hoc comparisons between the two have been published. In this paper, we set out to answer the question on which is better: neural network quantization or pruning? By answering this question, we hope to inform design decisions made on neural network hardware going forward. We provide an extensive comparison between the two techniques for compressing deep neural …

abstract arxiv cs.lg network networks neural network neural networks paper pruning quantization quantization techniques question set type