Generalized Entropy and Decision Trees
msra
摘要
We introduce an extension of the notion of Shannon conditional entropy to a more general form of conditional entropy that captures both the conditional Shannon entropy and a similar notion related to the Gini index. The proposed family of conditional entropies generates a collection of metrics over the set of partitions of finite sets, which can be used to construct decision trees. Experimental results suggest that by varying the parameter that defines the entropy it is possible to obtain smaller decision trees for certain databases without sacrificing accurracy.
更多查看译文
关键词
index de gini,partition,generalized conditional entropy,de- cision tree mots-clés : entropie de shannon,metric,entropie conditionnelle generalisée,métrique,shannon entropy,arbre de décision,gini index
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络