Video Preview Generation For Interactive Educational Digital Resources Based On The Gui Traversal

The interactive educational digital resources (IEDRs) are more and more prevalent in all levels of education. With the proliferation of the Internet, more and more IEDRs are being shared online. How to aid users to explore helpful resources effectively and efficiently has become a challenge. The static preview of resources that current research has mainly focused on is ineffective for the IEDRs, because of the unique feature of the IEDRs that the knowledge is crucial for the users' comprehension and is hidden in the process of interaction. To unfold the hidden crucial knowledge and ensure a users' fast acquisition, we proposed a novel approach to generate video previews for the IEDRs, which has achieved a better visualization of the IEDRs. First, the interactive element set and the events set, as well as the dependencies between the interactive elements of the resource are collected. Afterwards, by analyzing the dependencies, the interaction sequence is generated. Consequently, by automatically executing the interaction sequence based on the GUI traversal, the manual interaction is simulated, and the process is recorded into a video. The approach was applied into a dynamic mathematics educational system, SuperSketchpad, and its effectiveness was validated by a user study, in which it was compared with the random event method and event permutation method in correctness, completeness and redundancy.