Extracting Learning Performance Indicators from Digital Learning Environments

In the last decades, there has been a steady adoption of digital online platforms as learning environments applied to all levels of education. This increasing adoption forces a transition in educational resources which has further been accelerated by the recent pandemic, leading to an almost complete online-only learning environment in some cases. The aim of this paper is to outline the methodology involved in setting up a framework for mapping course-specific data based on student activity to standard learning indicators, which will serve as an input to performance prediction algorithms. The process involves systematically surveying, capturing, and categorising the vast range of data available in digital learning platforms. The data are collected from two sample courses and distilled into five dimensions represented by the generic learning indicators: prior knowledge, preparation, participation, interaction, and performance. The data is weighted based on course development and teaching member's perspectives to account for course-wise variations. The framework established will allow portability of prediction algorithms between courses and provide a means for meaningful and directed learner formative feedback. Two courses, both bachelor-level and worth 5 European Credits (ECs), that use several online learning platforms in their teaching tools have been chosen in this study to explore the nature and range of student interaction data available, accessible, and usable in a course. The first course is Electromagnetics II at Eindhoven University of Technology, and the second course is Electronics at Delft University of Technology. Both Universities are located in the Netherlands. This work is in the scope of a broader study to use such learning indicators with predictive algorithms to provide a prognosis on individual student performance. The findings in this paper will enable the realization of student performance prediction at a very early stage in the course.