Millisecond-Response Tracking and Gazing System for UAVs: A Domestic Solution Based on "Phytium + Cambricon"
By: Yuchen Zhu, Longxiang Yin, Kai Zhao
Potential Business Impact:
Spots moving things faster for cameras.
In the frontier research and application of current video surveillance technology, traditional camera systems exhibit significant limitations of response delay exceeding 200 ms in dynamic scenarios due to the insufficient deep feature extraction capability of automatic recognition algorithms and the efficiency bottleneck of computing architectures, failing to meet the real-time requirements in complex scenes. To address this issue, this study proposes a heterogeneous computing architecture based on Phytium processors and Cambricon accelerator cards, constructing a UAV tracking and gazing system with millisecond-level response capability. At the hardware level, the system adopts a collaborative computing architecture of Phytium FT-2000/4 processors and MLU220 accelerator cards, enhancing computing power through multi-card parallelism. At the software level, it innovatively integrates a lightweight YOLOv5s detection network with a DeepSORT cascaded tracking algorithm, forming a closed-loop control chain of "detection-tracking-feedback". Experimental results demonstrate that the system achieves a stable single-frame comprehensive processing delay of 50-100 ms in 1920*1080 resolution video stream processing, with a multi-scale target recognition accuracy of over 98.5%, featuring both low latency and high precision. This study provides an innovative solution for UAV monitoring and the application of domestic chips.
Similar Papers
Fast Marker Detection for UV-Based Visual Relative Localisation in Agile UAV Swarms
Robotics
Helps drone swarms find each other super fast.
Thermal RGB Fusion for Micro-UAV Wildfire Perimeter Tracking with Minimal Comms
CV and Pattern Recognition
Drones map wildfires faster with less data.
Sub-Millisecond Event-Based Eye Tracking on a Resource-Constrained Microcontroller
Hardware Architecture
Tracks eyes super fast with little power.