Simba: Towards High-Fidelity and Geometrically-Consistent Point Cloud Completion via Transformation Diffusion
By: Lirui Zhang , Zhengkai Zhao , Zhi Zuo and more
Potential Business Impact:
Fixes broken 3D shapes by learning patterns.
Point cloud completion is a fundamental task in 3D vision. A persistent challenge in this field is simultaneously preserving fine-grained details present in the input while ensuring the global structural integrity of the completed shape. While recent works leveraging local symmetry transformations via direct regression have significantly improved the preservation of geometric structure details, these methods suffer from two major limitations: (1) These regression-based methods are prone to overfitting which tend to memorize instant-specific transformations instead of learning a generalizable geometric prior. (2) Their reliance on point-wise transformation regression lead to high sensitivity to input noise, severely degrading their robustness and generalization. To address these challenges, we introduce Simba, a novel framework that reformulates point-wise transformation regression as a distribution learning problem. Our approach integrates symmetry priors with the powerful generative capabilities of diffusion models, avoiding instance-specific memorization while capturing robust geometric structures. Additionally, we introduce a hierarchical Mamba-based architecture to achieve high-fidelity upsampling. Extensive experiments across the PCN, ShapeNet, and KITTI benchmarks validate our method's state-of-the-art (SOTA) performance.
Similar Papers
DAPointMamba: Domain Adaptive Point Mamba for Point Cloud Completion
CV and Pattern Recognition
Fixes 3D shape gaps in computer vision.
Repurposing 2D Diffusion Models for 3D Shape Completion
CV and Pattern Recognition
Fills in missing parts of 3D shapes.
DM3D: Deformable Mamba via Offset-Guided Gaussian Sequencing for Point Cloud Understanding
CV and Pattern Recognition
Helps computers understand 3D shapes better.