Tool-mediated HCI modelling instruction: evidence from three studies

Effective teaching of concepts related to human computer interaction (HCI) requires introduction of the core paradigms as well as the design and evaluation methodologies to the learners. In this paper, we investigate the learning effectiveness of a tool-mediated learning activity to support instruction of established human performance models, namely the Keystroke Level Model (KLM) and Fitts' law, and their application in web form design practice. The tool, named Keystroke Level Model Form Analyser (KLM-FA), supports learning through exploration by providing step-by-step tracing of the KLM modelling for any web form filling task. KLM-FA can be used in modelling exercises of either online or offline web forms according to different interaction strategies or users' characteristics. Three pretest-posttest studies involving 52 students in total enrolled in computer science curricula with different education delivery methods (campus-based, blended learning, distance learning) and levels (undergraduate, postgraduate) provide evidence for the effectiveness of the proposed learning activity. In all three studies, it was found that the KLM-FA activity had a significant positive effect on students' learning gain. In addition, students rated their perceived educational experience and KLM-FA usability as rather high. Content analysis of students' comments also found that KLM-FA is an educationally valuable and usable tool.