Transformer-based spectro-temporal fusion for Sentinel-2 super-resolution.

Multi-image super-resolution consists in fusing multiple images of the same scene to generate an image of higher spatial resolution. Recently, it has been demonstrated that for remotely sensed multispectral Sentine1-2 images, fusion performed in both spectral and temporal dimensions improves the reconstruction quality. However, the deep networks elaborated for this purpose are quite large and influence of the input data is difficult to interpret. In this paper, we show how to exploit transformer-based image fusion to reduce the number of trainable parameters by 30% and allow for increased interpretability with means of attention rollout. The reported experimental results performed over simulated and real-world data indicate that this does not affect the reconstruction quality, while at the same time the visualization tools may help in developing techniques for input data selection and preprocessing.