LLM-Assisted Semantic Guidance for Sparsely Annotated Remote Sensing Object Detection
By: Wei Liao , Chunyan Xu , Chenxu Wang and more
Potential Business Impact:
Helps computers find objects in satellite pictures.
Sparse annotation in remote sensing object detection poses significant challenges due to dense object distributions and category imbalances. Although existing Dense Pseudo-Label methods have demonstrated substantial potential in pseudo-labeling tasks, they remain constrained by selection ambiguities and inconsistencies in confidence estimation.In this paper, we introduce an LLM-assisted semantic guidance framework tailored for sparsely annotated remote sensing object detection, exploiting the advanced semantic reasoning capabilities of large language models (LLMs) to distill high-confidence pseudo-labels.By integrating LLM-generated semantic priors, we propose a Class-Aware Dense Pseudo-Label Assignment mechanism that adaptively assigns pseudo-labels for both unlabeled and sparsely labeled data, ensuring robust supervision across varying data distributions. Additionally, we develop an Adaptive Hard-Negative Reweighting Module to stabilize the supervised learning branch by mitigating the influence of confounding background information. Extensive experiments on DOTA and HRSC2016 demonstrate that the proposed method outperforms existing single-stage detector-based frameworks, significantly improving detection performance under sparse annotations.
Similar Papers
Adaptive Guidance Semantically Enhanced via Multimodal LLM for Edge-Cloud Object Detection
CV and Pattern Recognition
Helps cameras see better in dark or crowded places.
Large Language Model Guided Progressive Feature Alignment for Multimodal UAV Object Detection
CV and Pattern Recognition
Helps drones see objects better using text.
Foundation Models for Remote Sensing: An Analysis of MLLMs for Object Localization
CV and Pattern Recognition
Helps computers find things in satellite pictures.