Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System
By: Romeo Valentin , Sydney M. Katz , Artur B. Carneiro and more
Potential Business Impact:
Helps planes land safely using cameras.
Recent advances in data-driven computer vision have enabled robust autonomous navigation capabilities for civil aviation, including automated landing and runway detection. However, ensuring that these systems meet the robustness and safety requirements for aviation applications remains a major challenge. In this work, we present a practical vision-based pipeline for aircraft pose estimation from runway images that represents a step toward the ability to certify these systems for use in safety-critical aviation applications. Our approach features three key innovations: (i) an efficient, flexible neural architecture based on a spatial Soft Argmax operator for probabilistic keypoint regression, supporting diverse vision backbones with real-time inference; (ii) a principled loss function producing calibrated predictive uncertainties, which are evaluated via sharpness and calibration metrics; and (iii) an adaptation of Residual-based Receiver Autonomous Integrity Monitoring (RAIM), enabling runtime detection and rejection of faulty model outputs. We implement and evaluate our pose estimation pipeline on a dataset of runway images. We show that our model outperforms baseline architectures in terms of accuracy while also producing well-calibrated uncertainty estimates with sub-pixel precision that can be used downstream for fault detection.
Similar Papers
Synthetic Data for Robust Runway Detection
Machine Learning (CS)
Teaches self-flying planes to land safely.
CNN-Based Camera Pose Estimation and Localisation of Scan Images for Aircraft Visual Inspection
Robotics
Lets planes get checked for damage faster.
Uncertainty-Aware Autonomous Vehicles: Predicting the Road Ahead
Robotics
Helps self-driving cars know when they're unsure.