PCR-ORB: Enhanced ORB-SLAM3 with Point Cloud Refinement Using Deep Learning-Based Dynamic Object Filtering
By: Sheng-Kai Chen , Jie-Yu Chao , Jr-Yu Chang and more
Potential Business Impact:
Cleans up robot vision in busy places.
Visual Simultaneous Localization and Mapping (vSLAM) systems encounter substantial challenges in dynamic environments where moving objects compromise tracking accuracy and map consistency. This paper introduces PCR-ORB (Point Cloud Refinement ORB), an enhanced ORB-SLAM3 framework that integrates deep learning-based point cloud refinement to mitigate dynamic object interference. Our approach employs YOLOv8 for semantic segmentation combined with CUDA-accelerated processing to achieve real-time performance. The system implements a multi-stage filtering strategy encompassing ground plane estimation, sky region removal, edge filtering, and temporal consistency validation. Comprehensive evaluation on the KITTI dataset (sequences 00-09) demonstrates performance characteristics across different environmental conditions and scene types. Notable improvements are observed in specific sequences, with sequence 04 achieving 25.9% improvement in ATE RMSE and 30.4% improvement in ATE median. However, results show mixed performance across sequences, indicating scenario-dependent effectiveness. The implementation provides insights into dynamic object filtering challenges and opportunities for robust navigation in complex environments.
Similar Papers
VAR-SLAM: Visual Adaptive and Robust SLAM for Dynamic Environments
Robotics
Helps robots see and move in busy places.
RSV-SLAM: Toward Real-Time Semantic Visual SLAM in Indoor Dynamic Environments
Robotics
Helps robots see and move in busy places.
Real-Time 3D Object Detection with Inference-Aligned Learning
CV and Pattern Recognition
Helps robots see and understand objects in 3D.