An Experiment on Feature Selection using Logistic Regression

In supervised machine learning, feature selection plays a very important role by potentially enhancing explainability and performance as measured by computing time and accuracy-related metrics. In this paper, we investigate a method for feature selection based on the well-known L1 and L2 regularization strategies associated with logistic regression (LR). It is well known that the learned coefficients, which serve as weights, can be used to rank the features. Our approach is to synthesize the findings of L1 and L2 regularization. …

accuracy computing cs.lg experiment explainability feature feature selection logistic regression machine machine learning metrics paper performance regression regularization role strategies supervised machine learning