Incremental Object Detection with Prompt-based Methods
By: Matthias Neuwirth-Trapp , Maarten Bieshaar , Danda Pani Paudel and more
Potential Business Impact:
Teaches computers to find new things in pictures.
Visual prompt-based methods have seen growing interest in incremental learning (IL) for image classification. These approaches learn additional embedding vectors while keeping the model frozen, making them efficient to train. However, no prior work has applied such methods to incremental object detection (IOD), leaving their generalizability unclear. In this paper, we analyze three different prompt-based methods under a complex domain-incremental learning setting. We additionally provide a wide range of reference baselines for comparison. Empirically, we show that the prompt-based approaches we tested underperform in this setting. However, a strong yet practical method, combining visual prompts with replaying a small portion of previous data, achieves the best results. Together with additional experiments on prompt length and initialization, our findings offer valuable insights for advancing prompt-based IL in IOD.
Similar Papers
Overcoming Prompts Pool Confusion via Parameterized Prompt for Incremental Object Detection
CV and Pattern Recognition
Teaches computers to recognize new things without forgetting old ones.
Generalizable Object Re-Identification via Visual In-Context Prompting
CV and Pattern Recognition
Finds same objects in new places without retraining.
Towards Generalizable AI-Generated Image Detection via Image-Adaptive Prompt Learning
CV and Pattern Recognition
Finds fake pictures from new AI tools.