MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Experts
By: Jingnan Gao , Zhe Wang , Xianze Fang and more
Potential Business Impact:
Builds 3D shapes from pictures more accurately.
Recent advances in language and vision have demonstrated that scaling up model capacity consistently improves performance across diverse tasks. In 3D visual geometry reconstruction, large-scale training has likewise proven effective for learning versatile representations. However, further scaling of 3D models is challenging due to the complexity of geometric supervision and the diversity of 3D data. To overcome these limitations, we propose MoRE, a dense 3D visual foundation model based on a Mixture-of-Experts (MoE) architecture that dynamically routes features to task-specific experts, allowing them to specialize in complementary data aspects and enhance both scalability and adaptability. Aiming to improve robustness under real-world conditions, MoRE incorporates a confidence-based depth refinement module that stabilizes and refines geometric estimation. In addition, it integrates dense semantic features with globally aligned 3D backbone representations for high-fidelity surface normal prediction. MoRE is further optimized with tailored loss functions to ensure robust learning across diverse inputs and multiple geometric tasks. Extensive experiments demonstrate that MoRE achieves state-of-the-art performance across multiple benchmarks and supports effective downstream applications without extra computation.
Similar Papers
SkyMoE: A Vision-Language Foundation Model for Enhancing Geospatial Interpretation with Mixture of Experts
CV and Pattern Recognition
Helps satellites understand Earth better from space.
MoRe: Monocular Geometry Refinement via Graph Optimization for Cross-View Consistency
CV and Pattern Recognition
Makes 3D pictures from one camera better.
Mixture of Ranks with Degradation-Aware Routing for One-Step Real-World Image Super-Resolution
CV and Pattern Recognition
Makes blurry pictures sharp using smart computer parts.