MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details
By: Ruicheng Wang , Sicheng Xu , Yue Dong and more
Potential Business Impact:
Makes one picture show 3D depth and size.
We propose MoGe-2, an advanced open-domain geometry estimation model that recovers a metric scale 3D point map of a scene from a single image. Our method builds upon the recent monocular geometry estimation approach, MoGe, which predicts affine-invariant point maps with unknown scales. We explore effective strategies to extend MoGe for metric geometry prediction without compromising the relative geometry accuracy provided by the affine-invariant point representation. Additionally, we discover that noise and errors in real data diminish fine-grained detail in the predicted geometry. We address this by developing a unified data refinement approach that filters and completes real data from different sources using sharp synthetic labels, significantly enhancing the granularity of the reconstructed geometry while maintaining the overall accuracy. We train our model on a large corpus of mixed datasets and conducted comprehensive evaluations, demonstrating its superior performance in achieving accurate relative geometry, precise metric scale, and fine-grained detail recovery -- capabilities that no previous methods have simultaneously achieved.
Similar Papers
Geometry-Constrained Monocular Scale Estimation Using Semantic Segmentation for Dynamic Scenes
CV and Pattern Recognition
Helps cars know where they are using one camera.
MoRe: Monocular Geometry Refinement via Graph Optimization for Cross-View Consistency
CV and Pattern Recognition
Makes 3D pictures from one camera better.
Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction
CV and Pattern Recognition
Makes 3D pictures from photos better.