Alleviating naive Bayes attribute independence assumption by attribute weighting
Journal of Machine Learning Research(2013)
摘要
Despite the simplicity of the Naive Bayes classifier, it has continued to perform well against more sophisticated newcomers and has remained, therefore, of great interest to the machine learning community. Of numerous approaches to refining the naive Bayes classifier, attribute weighting has received less attention than it warrants. Most approaches, perhaps influenced by attribute weighting in other machine learning algorithms, use weighting to place more emphasis on highly predictive attributes than those that are less predictive. In this paper, we argue that for naive Bayes attribute weighting should instead be used to alleviate the conditional independence assumption. Based on this premise, we propose a weighted naive Bayes algorithm, called WANBIA, that selects weights to minimize either the negative conditional log likelihood or the mean squared error objective functions. We perform extensive evaluations and find that WANBIA is a competitive alternative to state of the art classifiers like Random Forest, Logistic Regression and A1DE.
更多查看译文
关键词
negative conditional log likelihood,use weighting,weighted naive bayes algorithm,logistic regression,art classifier,naive bayes classifier,attribute weighting,conditional independence assumption,naive bayes,predictive attribute,classification
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络