DIR-TIR: Dialog-Iterative Refinement for Text-to-Image Retrieval
By: Zongwei Zhen, Biqing Zeng
Potential Business Impact:
Finds exact pictures by talking with you.
This paper addresses the task of interactive, conversational text-to-image retrieval. Our DIR-TIR framework progressively refines the target image search through two specialized modules: the Dialog Refiner Module and the Image Refiner Module. The Dialog Refiner actively queries users to extract essential information and generate increasingly precise descriptions of the target image. Complementarily, the Image Refiner identifies perceptual gaps between generated images and user intentions, strategically reducing the visual-semantic discrepancy. By leveraging multi-turn dialogues, DIR-TIR provides superior controllability and fault tolerance compared to conventional single-query methods, significantly improving target image hit accuracy. Comprehensive experiments across diverse image datasets demonstrate our dialogue-based approach substantially outperforms initial-description-only baselines, while the synergistic module integration achieves both higher retrieval precision and enhanced interactive experience.
Similar Papers
Diffusion Augmented Retrieval: A Training-Free Approach to Interactive Text-to-Image Retrieval
Information Retrieval
Finds images better, even with tricky searches.
Towards Natural Language-Based Document Image Retrieval: New Dataset and Benchmark
CV and Pattern Recognition
Finds documents using words, not just pictures.
TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generation
CV and Pattern Recognition
Makes AI pictures match your exact ideas.