Nov. 23, 2023, 6:08 a.m. | Gabe Verzino

Towards Data Science - Medium

Background, implementation, and model improvement

Among the trees (photo by author)

Decision trees (DT) get ditched much too soon.

It happens like this:

The DT is trained. Natural overfitting presents. Hyper-parameters get tuned (unsatisfactorily). Finally, the tree is replaced with Random Forest.

While that may be a quick win for performance, the replacement prioritizes a “black box” algorithm. That’s not ideal. Only a DT can produce intuitive results, offer business leaders the ability to compare trade-offs, and gives them a …

author business strategy data science decision decision-tree decision trees exploratory-data-analysis implementation natural overfitting parameters performance photo python random replacement tree trees

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Data Analyst (Commercial Excellence)

@ Allegro | Poznan, Warsaw, Poland

Senior Machine Learning Engineer

@ Motive | Pakistan - Remote

Summernaut Customer Facing Data Engineer

@ Celonis | Raleigh, US, North Carolina

Data Engineer Mumbai

@ Nielsen | Mumbai, India