Logistic Regression and the Feature Scaling Ensemble

A new groove toward optimality for linear classification

Principle Researcher: Dave Guggenheim / Contributor: Utsav Vachhani

The Down Beat

This work is a continuation of our earlier research into feature scaling (see here: The Mystery of Feature Scaling is Finally Solved | by Dave Guggenheim | Towards Data Science). In this project, we’ll examine the effect of 15 different scaling methods across 60 datasets using ridge-regularized logistic regression.

We will show how powerful …

bias-variance-tradeoff ensemble ensemble-learning feature-scaling logistic regression performance regression scaling