SChanger: Change Detection from a Semantic Change and Spatial Consistency Perspective
By: Ziyu Zhou , Keyan Hu , Yutian Fang and more
Potential Business Impact:
Finds changes in Earth pictures better.
Change detection is a key task in Earth observation applications. Recently, deep learning methods have demonstrated strong performance and widespread application. However, change detection faces data scarcity due to the labor-intensive process of accurately aligning remote sensing images of the same area, which limits the performance of deep learning algorithms. To address the data scarcity issue, we develop a fine-tuning strategy called the Semantic Change Network (SCN). We initially pre-train the model on single-temporal supervised tasks to acquire prior knowledge of instance feature extraction. The model then employs a shared-weight Siamese architecture and extended Temporal Fusion Module (TFM) to preserve this prior knowledge and is fine-tuned on change detection tasks. The learned semantics for identifying all instances is changed to focus on identifying only the changes. Meanwhile, we observe that the locations of changes between the two images are spatially identical, a concept we refer to as spatial consistency. We introduce this inductive bias through an attention map that is generated by large-kernel convolutions and applied to the features from both time points. This enhances the modeling of multi-scale changes and helps capture underlying relationships in change detection semantics. We develop a binary change detection model utilizing these two strategies. The model is validated against state-of-the-art methods on six datasets, surpassing all benchmark methods and achieving F1 scores of 92.87%, 86.43%, 68.95%, 97.62%, 84.58%, and 93.20% on the LEVIR-CD, LEVIR-CD+, S2Looking, CDD, SYSU-CD, and WHU-CD datasets, respectively.
Similar Papers
CSD: Change Semantic Detection with only Semantic Change Masks for Damage Assessment in Conflict Zones
CV and Pattern Recognition
Spots building damage from space quickly.
TaCo: Capturing Spatio-Temporal Semantic Consistency in Remote Sensing Change Detection
CV and Pattern Recognition
Helps satellites spot changes by understanding text.
Label-frugal satellite image change detection with generative virtual exemplar learning
CV and Pattern Recognition
Finds changes in pictures with less work.