A Mathematical Model for Curriculum Learning for Parities

arXiv:2301.13833v2 Announce Type: replace
Abstract: Curriculum learning (CL) - training using samples that are generated and presented in a meaningful order - was introduced in the machine learning context around a decade ago. While CL has been extensively used and analysed empirically, there has been very little mathematical justification for its advantages. We introduce a CL model for learning the class of k-parities on d bits of a binary string with a neural network trained by stochastic gradient descent (SGD). …

abstract advantages arxiv context cs.lg curriculum curriculum learning generated machine machine learning samples training type