Understanding Clinical Reasoning through Visual Scanpath and Brain Activity Analysis

This paper presents an experimental study that analyzes learners' visual behaviour and brain activity in clinical reasoning. An acquisition protocol was defined to record eye tracking and EEG data from 15 participants as they interact with a computer-based learning environment called Amnesia, a medical simulation system that assesses the analytical skills of novice medicine students while they solve patient cases. We use gaze data to assess learners' visual focus and present our methodology to track learners' reasoning process through scanpath pattern analysis. We also describe our methodology for examining learners' cognitive states using mental engagement and workload neural indexes. Finally, we discuss the relationship between gaze path information and EEG and how our analyses can lead to new forms of clinical diagnostic reasoning assessment.