Hybird Single-Multiple Frame Super-Resolution Reconstruction Of Video Face Image

The goal of super-resolution (SR) face image reconstruction is to generate a high quality and high resolution (HR) image based on low resolution (LR) input face images, to support video face recognition. This paper proposes a novel hybrid SR reconstruction framework of combining a multiframe SR interpolation method and a learning based single frame SR method. The proposed framework first formulates a simple but effective frame selection strategy as a preprocessing step. A weight map based on canonical correlation analysis (CCA) theory is then estimated to blend the results from single frame SR method and multiframe SR approach. Experimental results demonstrate that the proposed method achieves competitive performance against the state-of-the-art both simulated and real LR sequences.