Feature Selection Using Zentropy-Based Uncertainty Measure

Feature selection and entropy theory are two efficacious data analysis tools for investigating uncertainty information processing in artificial intelligence. The fruitful marriage of the two has been an active research topic in knowledge discovery. Currently, most feature selection methods via entropy theory mainly focus on the information measures at a single granular level. However, it ignores the interaction between granular levels, which leads to the poor stability and accuracy of related methods. Hence, this paper proposes a novel zentropy-based uncertainty measure to design a feature selection method by exploiting the granular level structure in knowledge space. Subsequently, by analyzing the granular level structure in decision data, the zentropy-based uncertainty measure and its properties are designed and analyzed to depict the uncertainty knowledge from whole and internal. Moreover, two importance measures are defined to evaluate features based on the designed uncertainty measure, and then a corresponding feature selection algorithm is developed. Finally, some experiments are carried out on public datasets to demonstrate that the proposed method can achieve state-of-the-art performance among methods, especially regarding stability and classification accuracy.