Leveraging AV1 motion vectors for Fast and Dense Feature Matching
By: Julien Zouein , Hossein Javidnia , François Pitié and more
Potential Business Impact:
Finds matching points in videos faster, using less power.
We repurpose AV1 motion vectors to produce dense sub-pixel correspondences and short tracks filtered by cosine consistency. On short videos, this compressed-domain front end runs comparably to sequential SIFT while using far less CPU, and yields denser matches with competitive pairwise geometry. As a small SfM demo on a 117-frame clip, MV matches register all images and reconstruct 0.46-0.62M points at 0.51-0.53,px reprojection error; BA time grows with match density. These results show compressed-domain correspondences are a practical, resource-efficient front end with clear paths to scaling in full pipelines.
Similar Papers
Leveraging AV1 motion vectors for Fast and Dense Feature Matching
CV and Pattern Recognition
Finds matching spots in videos with less computer power.
Temporal Realism Evaluation of Generated Videos Using Compressed-Domain Motion Vectors
CV and Pattern Recognition
Makes AI videos move more like real life.
AV1 Motion Vector Fidelity and Application for Efficient Optical Flow
Image and Video Processing
Speeds up video analysis by using existing motion data.