Current Status of Open Science and Statistical Analysis in The Japanese Journal of Educational Psychology: Consideration From the Severe Testing Perspective

This study reviewed 28 research papers published in The Japanese Journal of Educational Psychology, from issue 3 of volume 69 to issue 2 of volume 79, to assess new research practices such as pre-registration, the use of the Open Science Framework, and statistical methods, including Bayesian methods. The results indicated that the new research practices were not pervasive in this journal. We also discussed new research practices and statistical methods from the severe testing perspective. In addition, a confidence curve was explained to visualize the results of statistical hypothesis testing. Finally, based on the insights from our results, several approaches were proposed to improve these new research practices and statistical analyses.