AutoTutor Detects and Responds to Learners Affective and Cognitive States

This paper provides a synthesis of our research towards the devel- opment of an affect-sensitive Intelligent Tutoring System called AutoTutor. The affect-sensitive AutoTutor detects the emotions (boredom, flow/engagement, confusion, frustration) of a learner by monitoring conversa- tional cues, gross body language, and facial features. It is also mindful of the learners' affective and cognitive states in selecting its pedagogical and motiva- tional dialogue moves. Finally, the AutoTutor embodied pedagogical agent synthesizes affective responses through animated facial expressions and modu- lated speech. The paper provides an overview of our theoretical framework, methodology, implementation details, and results.