Validating The Contribution-Weighted Model: Robustness And Cost-Benefit Analyses
DECISION ANALYSIS(2016)
摘要
We use results from a multiyear, geopolitical forecasting tournament to highlight the ability of the contribution weighted model [Budescu DV, Chen E (2015) Identifying expertise to extract the wisdom of crowds. Management Sci. 61(2): 267-280] to capture and exploit expertise. We show that the model performs better when judges gain expertise from manipulations such as training in probabilistic reasoning and collaborative interaction from serving on teams. We document the model's robustness using probability judgments from early, middle, and late phases of the forecasting period and by showing its strong performance in the presence of hypothetical malevolent forecasters. The model is highly cost-effective: it operates well, even with random attrition, as the number of judges shrinks and information on their past performance is reduced.
更多查看译文
关键词
forecasts: combining, probability: weighting, probability: group, forecasts: aggregating, expertise, cost-benefit analysis
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络