Boosting, Voting Classifiers and Randomized Sample Compression Schemes

In boosting, we aim to leverage multiple weak learners to produce a strong learner. At the center of this paradigm lies the concept of building the strong learner as a voting classifier, which outputs a weighted majority vote of the weak learners. While many successful boosting algorithms, such as the iconic AdaBoost, produce voting classifiers, their theoretical performance has long remained sub-optimal: the best known bounds on the number of training examples necessary for a voting classifier to obtain a …

adaboost aim algorithms boosting building center classifier classifiers compression concept cs.lg lies multiple paradigm sample stat.ml voting