Image fusion of spatial inconsistency IR dual-band detector

Dual-band IR detector can obtain infrared radiation information of two bands at the same time, which has many advantages compared with single-band detector in application. At present, there are two types of dual-band detectors: one is that pixels of the two bands align perfectly, and the other is that pixels of the two bands do not align perfectly, resulting in spatial inconsistency. The spatial inconsistency dual-band detector has the advantages of perfect temporal consistency and no need for deep mesa etching, but needs more complex image fusion processing to utilize its advantages. On one hand, the difference between images of two bands contains both spatial and band differences, which makes it more difficult to accurately use band information. On the other hand, pixels of the two bands do not align perfectly, which means that higher frequency spatial information can be collected, taking advantage of these information is conducive to improving the resolution of the image. In this paper, an image fusion framework is proposed. Firstly, band differences and spatial differences are separated and reconstructed, and then the band differences are enhanced by pseudo-color fusion algorithm. Through moving a spatial consistency detector with sub-pixel displacement, we get images to verify ours fusion scheme. Experimental results show that the proposed fusion algorithm can extract and enhance the band difference information, and improve the resolution of high frequency spatial information.