An information theoretic approach to quantify the stability of feature selection and ranking algorithms

Feature selection is a key step when dealing with high dimensional data. In particular, these techniques simplify the process of knowledge discovery from the data by selecting the most relevant features out of the noisy, redundant and irrelevant features. A problem that arises in many of these practical applications is that the outcome of the feature selection algorithm is not stable. Thus, small variations in the data may yield very different feature rankings. Assessing the stability of these methods becomes …

algorithms cs.ai cs.lg data discovery feature features feature selection information key knowledge process ranking stability