Zero-Splat TeleAssist: A Zero-Shot Pose Estimation Framework for Semantic Teleoperation
By: Srijan Dokania, Dharini Raghavan
We introduce Zero-Splat TeleAssist, a zero-shot sensor-fusion pipeline that transforms commodity CCTV streams into a shared, 6-DoF world model for multilateral teleoperation. By integrating vision-language segmentation, monocular depth, weighted-PCA pose extraction, and 3D Gaussian Splatting (3DGS), TeleAssist provides every operator with real-time global positions and orientations of multiple robots without fiducials or depth sensors in an interaction-centric teleoperation setup.
Similar Papers
ViTa-Zero: Zero-shot Visuotactile Object 6D Pose Estimation
Robotics
Robots can better grab and move objects.
SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting
CV and Pattern Recognition
Lets cameras know exactly where things are.
Unlocking Zero-shot Potential of Semi-dense Image Matching via Gaussian Splatting
CV and Pattern Recognition
Makes computer vision better at matching pictures.