TEA: Temporal Adaptive Satellite Image Semantic Segmentation
By: Juyuan Kang , Hao Zhu , Yan Zhu and more
Potential Business Impact:
Helps farmers know exactly where crops are.
Crop mapping based on satellite images time-series (SITS) holds substantial economic value in agricultural production settings, in which parcel segmentation is an essential step. Existing approaches have achieved notable advancements in SITS segmentation with predetermined sequence lengths. However, we found that these approaches overlooked the generalization capability of models across scenarios with varying temporal length, leading to markedly poor segmentation results in such cases. To address this issue, we propose TEA, a TEmporal Adaptive SITS semantic segmentation method to enhance the model's resilience under varying sequence lengths. We introduce a teacher model that encapsulates the global sequence knowledge to guide a student model with adaptive temporal input lengths. Specifically, teacher shapes the student's feature space via intermediate embedding, prototypes and soft label perspectives to realize knowledge transfer, while dynamically aggregating student model to mitigate knowledge forgetting. Finally, we introduce full-sequence reconstruction as an auxiliary task to further enhance the quality of representations across inputs of varying temporal lengths. Through extensive experiments, we demonstrate that our method brings remarkable improvements across inputs of different temporal lengths on common benchmarks. Our code will be publicly available.
Similar Papers
A Joint Learning Framework with Feature Reconstruction and Prediction for Incomplete Satellite Image Time Series in Agricultural Semantic Segmentation
CV and Pattern Recognition
Helps farmers track crops even with cloudy skies.
Sugar-Beet Stress Detection using Satellite Image Time Series
CV and Pattern Recognition
Finds sick sugar-beet plants from space.
Tracking and Segmenting Anything in Any Modality
CV and Pattern Recognition
Lets computers understand any video task.