On the Trade-off between the Number of Nodes and the Number of Trees in a Random Forest

In this paper, we focus on the prediction phase of a random forest and study the problem of representing a bag of decision trees using a smaller bag of decision trees, where we only consider binary decision problems on the binary domain and simple decision trees in which an internal node is limited to querying the Boolean value of a single variable. As a main result, we show that the majority function of $n$ variables can be represented by a …

bag binary cs.lg decision decision trees domain focus paper prediction random study trade trade-off trees