Invisible emotion magnification algorithm (IEMA) for real-time micro-expression recognition with graph-based features

The interest in real-time micro-expression recognition has increased with the current trend in human-computer interaction applications. Presently, there are several approaches which include geometrical analysis for fast facial muscle movement feature representations. However, due to the subtleness of emotions, recognition accuracy remains a challenge in this field. In order to address this challenge, this paper put forward a novel geometrical-based invisible emotion magnification algorithm (IEMA). This algorithm utilizes facial landmarks of on-set and apex frames to compute magnication elements as well as the direction of facial movement, and then applies them to the x and y coordinates of the apex-frame to enhance the magnitude of facial muscle movement for invisible emotion. Furthermore, this algorithm integrates a parameter which is set to adjust the magnification level in order to achieve optimal performance. The proposed IEMA was analyzed using a landmark-based facial graph, and subsequently, the euclidean distance and gradient of the graph segments were presented as features. The experimental results suggest that the proposed IEMA yields the highest accuracy of 94.78