Assessing the Learning Path Specification: a Pragmatic Quality Approach

Finding suitable ways to achieve particular learning goals is not an easy task, both in initial education and lifelong learning. To facilitate selection, personalisation and navigation of learning paths we propose to describe learning paths in a formal and uniform way by means of a learning path specification. This paper explains the rationale behind the Learning Path Specification. Based on a framework developed for the evaluation of the specification the paper describes a study that was carried out to establish pragmatic quality, i.e. whether stakeholders can understand and use the specification. The paper explores the relationship between the concepts pragmatic quality, usability, and desirability, and distinguishes first-order and second-order pragmatic quality, relating it to different stakeholders: software developers and end-users. First-order pragmatic quality of the Learning Path Specification was evaluated during the process of developing a tool that describes learning paths according to the specification: the Learning Path Editor. Second-order pragmatic quality was evaluated through workshop sessions with end-users involving some hands-on experiences with this tool. The paper describes adaptations made to the specification in the process of developing the Editor. End-user evaluations were quite positive, leading to one more adaptation.