Feature Selection In Web Applications By Roc Inflections And Powerset Pruning
SAINT '01: Proceedings of the 2001 Symposium on Applications and the Internet (SAINT 2001)(2001)
摘要
A basic problem of information processing is selecting enough features to ensure that events are accurately represented for classification problems, while simultaneously minimizing storage and processing of irrelevant or marginally important features. To address this problem, feature selection procedures perform a search through the feature power set to find the smallest subset meeting performance requirements. Major restrictions of existing procedures are that they typically explicitly or implicitly assume a fixed operating point, and make limited use of the statistical structure of the feature power set. We present a method that combines the Neyman-Pearson design procedure on finite data, with the directed set structure of the Receiver Operating Curves on the feature subsets, to determine the maximal size of the feature subsets than can be ranked in a given problem. The search can then be restricted to the smaller subsets, resulting in significant reductions in computational complexity. Optimizing the overall Receiver Operating Curve also allows for end users to select different operating points and cost functions to optimize. The algorithm also produces a natural method of Boolean representation of the minimal feature combinations that best describe the data near a given operating point. These representations are especially appropriate when describing data using common text-related features useful on the web, such as thresholded TFIDF data. We show how to use these results to perform automatic Boolean query modification generation for distributed databases, such as niche metasearch engines.
更多查看译文
关键词
Internet,computational complexity,distributed databases,information resources,information retrieval,search engines,Boolean query modification generation,Boolean representation,Internet,ROC inflections,Receiver Operating Curves,World Wide Web applications,classification,computational complexity,design procedure,distributed databases,feature selection,information processing,metasearch engines,performance requirements,powerset pruning,text-related features,
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络