Statistical power and parameter stability when subjects are few and tests are many: comment on Peterson, Smith, Martorana, and Owens (2003).
JOURNAL OF APPLIED PSYCHOLOGY(2006)
摘要
This comment illustrates how small sample sizes, when combined with many statistical tests, can generate unstable parameter estimates and invalid inferences. Although statistical power for I test in a small-sample context is too low, the experimentwise power is often high when many tests are conducted, thus leading to Type I errors that will not replicate when retested. This comment's results show how radically the specific conclusions and inferences in R. S. Peterson, D. B. Smith. P. V. Martorana, and P. D. Owens's (2003) study changed with the inclusion or exclusion of I data point. When a more appropriate experimentwise statistical test was applied, the instability in the inferences was eliminated, but all the inferences become nonsignificant, thus changing the positive conclusions.
更多查看译文
关键词
power,sample size,teams
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络