Validation of a Repeatable Pair Comparison Method Subjective Evaluation of 8K 120 and 60 Hz Encoded Videos

In this study, we verify a pair comparison method in which videos being evaluated can be repeated by the evaluators as many times as desired. We use the method to conduct a subjective evaluation of 8K 119.88 Hz (120 Hz) and 59.94 Hz (60 Hz) videos that were compressed using software that emulates an 8K 120 Hz encoder. The experimental results confirm that (1) this method can detect small differences between video qualities, (2) all video pairs must be evaluated because the order effect is not negligible, and (3) the appropriate number of repeats is between four and nine.