Combining morphological filtering, anisotropic diffusion and block-based data replication for automatically detecting and recovering unscanned gaps in remote sensing images

Author(s)

Basso, Dayara ; Colnago, Marilaine ; Azevedo, Samara ; Silva, Erivaldo ; Pina, Pedro ; Casaca, Wallace

• Document type: Journal article
• Source: EARTH SCIENCE INFORMATICS; v. 14, n. 3, p. 14-pg., 2021-04-11.

Abstract

Filling damaged pixels in satellite images is a key task present in many Remote Sensing applications. As a representative example of image restoration issue, we can refer to the failure of the Scan Line Corrector (SLC) on board the Landsat Enhanced Thematic Mapper Plus (ETM +) sensor, in which 22% of the scanned pixels in the SLC-off images were missed, thus creating unexpected stipe-type gaps in the scenes. In order to improve the usability of ETM + SLC-off data in a straightforward manner, in this paper we propose a unified methodology that automatically segments and repairs Landsat-7 scenes occluded by stripes. The proposed framework combines Morphology-based filtering, anisotropic diffusion and block-based pixel replication as an effective, fully unsupervised restoration methodology designed to cope with different gap sizes in Landsat images. Our approach does not require having as input data any prior gap mask, side reference image or time-dependent frames of the same scene to work properly. As shown in the experimental results, the current methodology performs adequately for a variety of multispectral remote sensing images with different stripe-size thicknesses and heterogeneous segments. We attest to the accuracy and robustness of our end-to-end framework throughout a variety of qualitative and quantitative evaluations involving state-of-the-art restoration methods. (AU)

• FAPESP's process: 18/06756-3 - Development of an unsupervised inpainting methodology for occlusion removal in urban images
• Grantee: Dayara Pereira Basso
• Support Opportunities: Scholarships in Brazil - Scientific Initiation
• FAPESP's process: 19/24259-0 - Segmentation and inpainting of sensor failures in remote sensing images
• Grantee: Dayara Pereira Basso
• Support Opportunities: Scholarships abroad - Research Internship - Scientific Initiation