Seeking Emotion Labels for Bodily Reactions: An Experimental Study in Simulated Interviews

Abstract Computers rely on different methods and approaches to assess human affective information. Nevertheless, theoretically and methodologically, emotion is a challenging topic to address in Human-Computer Interaction. Exploring methods for assessing physiological responses to emotional experience and for aiding the emotion recognition features of Intelligent Virtual Agents (IVAs), this study developed an interface prototype for emotion elicitation and simultaneous acquisition of the user’s physiological and self-reported emotional data. Supplementary, the study ventures to combine such data through event-related signal analysis.