Interpreting Probabilistic Classifications From Diagnostic Psychometric Models
EDUCATIONAL MEASUREMENT-ISSUES AND PRACTICE(2019)
摘要
Although much research has been conducted on the psychometric properties of cognitive diagnostic models, they are only recently being used in operational settings to provide results to examinees and other stakeholders. Using this newer class of models in practice comes with a fresh challenge for diagnostic assessment developers: effectively reporting results and supporting end users to accurately interpret results. Achieving the goal of communicating results in a way that leads users of the assessment to make accurate interpretations requires a prerequisite step that cannot be taken for granted. The assessment developers must first accurately interpret results from a psychometric, or measurement, standpoint. Through this article, we seek to begin a discussion about reasonable interpretations of the results that classification-based models provide about examinees. Interpretations from published research and ongoing practice show different-and sometimes conflicting-ways to interpret these results. This article seeks to formalize a comparison, critique, and discussion among the interpretations. Before beginning this discussion, we first present background on the results provided by classification-based models regarding the examinees. We then structure our discussion around key questions an assessment development team needs to answer themselves prior to constructing reports and interpretative guides for end users of the assessment.
更多查看译文
关键词
cognitive diagnosis models,diagnostic classification models,diagnostic model reporting,probabilistic classification,score interpretation
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络