Research on a Framework for Analyzing Interactive Behaviors in Smart Classroom Based on Multimodal Data and Its Application.

The analysis of interactive behaviors in the classroom has been a hot topic since the proposal of the Flanders Interaction Analysis System. With the continuous development of information technology and intelligent educational environments, the types of classrooms are constantly changing. In order to deal with the popular smart classroom environment and explore its inherent nature, it is necessary to study the framework for analyzing interactive behaviors in smart classrooms. In smart classrooms, teachers and students generate a large amount of multimodal data not only in the physical environment but also in the virtual environment of the network. These data provide rich sources for researchers. Therefore, from the initial study of speech modal data analysis in the classroom to the current more accurate analysis of teacher-student interactions in smart classrooms through observing gestures, expressions, actions, and network platform data, it gradually becomes possible. This paper uses literature research methods and a multimodal perspective to observe high-quality smart classroom videos and summarize the interactive behaviors in smart classrooms. Based on this, a framework for analyzing interactive behaviors in smart classrooms based on multimodal data is designed, which is necessary.