FlowDet: Unifying Object Detection and Generative Transport Flows
By: Enis Baty, C. P. Bridges, Simon Hadfield
We present FlowDet, the first formulation of object detection using modern Conditional Flow Matching techniques. This work follows from DiffusionDet, which originally framed detection as a generative denoising problem in the bounding box space via diffusion. We revisit and generalise this formulation to a broader class of generative transport problems, while maintaining the ability to vary the number of boxes and inference steps without re-training. In contrast to the curved stochastic transport paths induced by diffusion, FlowDet learns simpler and straighter paths resulting in faster scaling of detection performance as the number of inference steps grows. We find that this reformulation enables us to outperform diffusion based detection systems (as well as non-generative baselines) across a wide range of experiments, including various precision/recall operating points using multiple feature backbones and datasets. In particular, when evaluating under recall-constrained settings, we can highlight the effects of the generative transport without over-compensating with large numbers of proposals. This provides gains of up to +3.6% AP and +4.2% AP$_{rare}$ over DiffusionDet on the COCO and LVIS datasets, respectively.
Similar Papers
FlowDet: Overcoming Perspective and Scale Challenges in Real-Time End-to-End Traffic Detection
CV and Pattern Recognition
Makes cameras see cars faster, even when crowded.
DriveFlow: Rectified Flow Adaptation for Robust 3D Object Detection in Autonomous Driving
CV and Pattern Recognition
Makes self-driving cars see better in new places.
C-DiffDet+: Fusing Global Scene Context with Generative Denoising for High-Fidelity Object Detection
CV and Pattern Recognition
Helps computers see tiny damage on cars.