Decision Trees Explained — Entropy, Information Gain, Gini Index, CCP Pruning..

Decision Trees Explained — Entropy, Information Gain, Gini Index, CCP Pruning

Though Decision Trees look simple and intuitive, there is nothing very simple about how the algorithm goes about the process deciding on splits and how tree pruning occurs. In this post I take you through a simple example to understand the inner workings of Decision Trees.

Iris Decision Tree from Scikit Learn ( Image source: sklearn)

Decision Trees are a popular and surprisingly effective technique, particularly for classification …

decision decision-tree entropy explained gini-index index information information-gain pruning trees