Optimized Scale-Invariant Feature Transform with Local Tri-directional Patterns for Facial Expression Recognition with Deep Learning Model

Facial expression recognition (FER) is the process of identifying human expressions. People vary in their accuracy at recognizing the emotions of others. Use of technology to help people with emotion recognition is a relatively important research area. Various works have been conducted on automating the recognition of facial expressions. The main intent of this paper is to plan for the FER model with the aid of intelligent techniques. The proposed models consist of steps like data collection, face detection, optimized feature extraction and emotion recognition. Initially, the standard benchmark facial emotion dataset is collected, and it is subjected to face detection. The optimized scale-invariant feature transform (OSIFT) is adopted for feature extraction, in which the key points that are giving unique information are optimized by the hybrid meta-heuristic algorithm. Two meta-heuristic algorithms like spotted hyena optimization and beetle swarm optimization (BSO) are merged to form the proposed spotted hyena-based BSO (SH-BSO). Also, the local tri-directional pattern is extracted, which is further combined with optimized SIFT. Here, the proposed SH-BSO is utilized for optimizing the number of hidden neurons of both deep neural network and convolutional neural network in such a way that the recognition accuracy could attain maximum.