Estimating Mutual Information Using Gaussian Mixture Model for Feature Ranking and Selection
IJCNN(2006)
摘要
Feature selection is a critical step for pattern recognition and many other applications. Typically, feature selection strategies can be categorized into wrapper and filter approaches. Filter approach has attracted much attention because of its flexibility and computational efficiency. Previously, we have developed an ICA-MI framework for feature selection, in which the mutual information (MI) between features and class labels was used as the criterion. However, since this method depends on the linearity assumption, it is not applicable for an arbitrary distribution. In this paper, exploiting the fact that Gaussian mixture model (GMM) is generally a suitable tool for estimating probability densities, we propose GMM-MI method for feature ranking and selection. We will discuss the details of GMM-MI algorithm and demonstrate the experimental results. We will also compare the GMM-MI method with the ICA-MI method in terms of performance and computational efficiency.
更多查看译文
关键词
pattern recognition,independent component analysis,feature ranking,mutual information estimation,gaussian processes,feature selection,gaussian mixture model,mutual information,probability density
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络