3D-ANC: Adaptive Neural Collapse for Robust 3D Point Cloud Recognition
By: Yuanmin Huang , Wenxuan Li , Mi Zhang and more
Potential Business Impact:
Makes 3D object recognition safer from tricks.
Deep neural networks have recently achieved notable progress in 3D point cloud recognition, yet their vulnerability to adversarial perturbations poses critical security challenges in practical deployments. Conventional defense mechanisms struggle to address the evolving landscape of multifaceted attack patterns. Through systematic analysis of existing defenses, we identify that their unsatisfactory performance primarily originates from an entangled feature space, where adversarial attacks can be performed easily. To this end, we present 3D-ANC, a novel approach that capitalizes on the Neural Collapse (NC) mechanism to orchestrate discriminative feature learning. In particular, NC depicts where last-layer features and classifier weights jointly evolve into a simplex equiangular tight frame (ETF) arrangement, establishing maximally separable class prototypes. However, leveraging this advantage in 3D recognition confronts two substantial challenges: (1) prevalent class imbalance in point cloud datasets, and (2) complex geometric similarities between object categories. To tackle these obstacles, our solution combines an ETF-aligned classification module with an adaptive training framework consisting of representation-balanced learning (RBL) and dynamic feature direction loss (FDL). 3D-ANC seamlessly empowers existing models to develop disentangled feature spaces despite the complexity in 3D data distribution. Comprehensive evaluations state that 3D-ANC significantly improves the robustness of models with various structures on two datasets. For instance, DGCNN's classification accuracy is elevated from 27.2% to 80.9% on ModelNet40 -- a 53.7% absolute gain that surpasses leading baselines by 34.0%.
Similar Papers
Scalable Class-Incremental Learning Based on Parametric Neural Collapse
CV and Pattern Recognition
Teaches computers new things without forgetting old ones.
A Lightweight 3D Anomaly Detection Method with Rotationally Invariant Features
CV and Pattern Recognition
Find weird spots in 3D shapes, no matter how they're turned.
Label-Efficient Point Cloud Segmentation with Active Learning
CV and Pattern Recognition
Teaches computers to learn from less 3D data.