Not every day is a sunny day: Synthetic cloud injection for deep land cover segmentation robustness evaluation across data sources
By: Sara Mobsite , Renaud Hostache , Laure Berti Equille and more
Potential Business Impact:
Radar sees land through clouds for better maps.
Supervised deep learning for land cover semantic segmentation (LCS) relies on labeled satellite data. However, most existing Sentinel-2 datasets are cloud-free, which limits their usefulness in tropical regions where clouds are common. To properly evaluate the extent of this problem, we developed a cloud injection algorithm that simulates realistic cloud cover, allowing us to test how Sentinel-1 radar data can fill in the gaps caused by cloud-obstructed optical imagery. We also tackle the issue of losing spatial and/or spectral details during encoder downsampling in deep networks. To mitigate this loss, we propose a lightweight method that injects Normalized Difference Indices (NDIs) into the final decoding layers, enabling the model to retain key spatial features with minimal additional computation. Injecting NDIs enhanced land cover segmentation performance on the DFC2020 dataset, yielding improvements of 1.99% for U-Net and 2.78% for DeepLabV3 on cloud-free imagery. Under cloud-covered conditions, incorporating Sentinel-1 data led to significant performance gains across all models compared to using optical data alone, highlighting the effectiveness of radar-optical fusion in challenging atmospheric scenarios.
Similar Papers
A Deep Learning Architecture for Land Cover Mapping Using Spatio-Temporal Sentinel-1 Features
CV and Pattern Recognition
Maps land changes from space more accurately.
CloudBreaker: Breaking the Cloud Covers of Sentinel-2 Images using Multi-Stage Trained Conditional Flow Matching on Sentinel-1
CV and Pattern Recognition
Makes cloudy satellite pictures clear for Earth study.
Learning with less: label-efficient land cover classification at very high spatial resolution using self-supervised deep learning
CV and Pattern Recognition
Maps land from space with less data.