Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoning
By: Shoaib Ahmmad , Zubayer Ahmed Aditto , Md Mehrab Hossain and more
Potential Business Impact:
Drones fly safely indoors without GPS.
Plain English Summary
Imagine a drone that can fly itself safely through a crowded warehouse or a tricky building without getting lost or bumping into things. This new system acts like the drone's eyes and brain, using smart technology to see obstacles and figure out where to go, even without GPS. This means drones can do jobs like delivering packages or inspecting buildings in places where they'd normally struggle, making them much more useful and reliable.
This paper introduces an advanced AI-driven perception system for autonomous quadcopter navigation in GPS-denied indoor environments. The proposed framework leverages cloud computing to offload computationally intensive tasks and incorporates a custom-designed printed circuit board (PCB) for efficient sensor data acquisition, enabling robust navigation in confined spaces. The system integrates YOLOv11 for object detection, Depth Anything V2 for monocular depth estimation, a PCB equipped with Time-of-Flight (ToF) sensors and an Inertial Measurement Unit (IMU), and a cloud-based Large Language Model (LLM) for context-aware decision-making. A virtual safety envelope, enforced by calibrated sensor offsets, ensures collision avoidance, while a multithreaded architecture achieves low-latency processing. Enhanced spatial awareness is facilitated by 3D bounding box estimation with Kalman filtering. Experimental results in an indoor testbed demonstrate strong performance, with object detection achieving a mean Average Precision (mAP50) of 0.6, depth estimation Mean Absolute Error (MAE) of 7.2 cm, only 16 safety envelope breaches across 42 trials over approximately 11 minutes, and end-to-end system latency below 1 second. This cloud-supported, high-intelligence framework serves as an auxiliary perception and navigation system, complementing state-of-the-art drone autonomy for GPS-denied confined spaces.
Similar Papers
AI and Vision based Autonomous Navigation of Nano-Drones in Partially-Known Environments
Robotics
Tiny drones fly themselves, avoiding obstacles.
Real-Time Navigation for Autonomous Aerial Vehicles Using Video
Robotics
Drones navigate faster and use less power.
Deep Learning-based Robust Autonomous Navigation of Aerial Robots in Dense Forests
Robotics
Drones fly safely through forests without crashing.