R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perception
By: Jonas Mirlach , Lei Wan , Andreas Wiedholz and more
Potential Business Impact:
Helps self-driving cars see people in the dark.
In autonomous driving, the integration of roadside perception systems is essential for overcoming occlusion challenges and enhancing the safety of Vulnerable Road Users(VRUs). While LiDAR and visual (RGB) sensors are commonly used, thermal imaging remains underrepresented in datasets, despite its acknowledged advantages for VRU detection in extreme lighting conditions. In this paper, we present R-LiViT, the first dataset to combine LiDAR, RGB, and thermal imaging from a roadside perspective, with a strong focus on VRUs. R-LiViT captures three intersections during both day and night, ensuring a diverse dataset. It includes 10,000 LiDAR frames and 2,400 temporally and spatially aligned RGB and thermal images across 150 traffic scenarios, with 7 and 8 annotated classes respectively, providing a comprehensive resource for tasks such as object detection and tracking. The dataset and the code for reproducing our evaluation results are made publicly available.
Similar Papers
Multi-Modal Camera-Based Detection of Vulnerable Road Users
CV and Pattern Recognition
Helps cars see people better in bad weather.
Thermal Detection of People with Mobility Restrictions for Barrier Reduction at Traffic Lights Controlled Intersections
CV and Pattern Recognition
Helps traffic lights see everyone, even in fog.
All-day Depth Completion via Thermal-LiDAR Fusion
CV and Pattern Recognition
Helps cars see clearly in rain and dark.