A Survey on Deep Multi-Task Learning in Connected Autonomous Vehicles
By: Jiayuan Wang , Farhad Pourpanah , Q. M. Jonathan Wu and more
Potential Business Impact:
Helps self-driving cars see and predict better.
Connected autonomous vehicles (CAVs) must simultaneously perform multiple tasks, such as object detection, semantic segmentation, depth estimation, trajectory prediction, motion prediction, and behaviour prediction, to ensure safe and reliable navigation in complex environments. Vehicle-to-everything (V2X) communication enables cooperative driving among CAVs, thereby mitigating the limitations of individual sensors, reducing occlusions, and improving perception over long distances. Traditionally, these tasks are addressed using distinct models, which leads to high deployment costs, increased computational overhead, and challenges in achieving real-time performance. Multi-task learning (MTL) has recently emerged as a promising solution that enables the joint learning of multiple tasks within a single unified model. This offers improved efficiency and resource utilization. To the best of our knowledge, this survey is the first comprehensive review focused on MTL in the context of CAVs. We begin with an overview of CAVs and MTL to provide foundational background. We then explore the application of MTL across key functional modules, including perception, prediction, planning, control, and multi-agent collaboration. Finally, we discuss the strengths and limitations of existing methods, identify key research gaps, and provide directions for future research aimed at advancing MTL methodologies for CAV systems.
Similar Papers
3D-Aware Multi-Task Learning with Cross-View Correlations for Dense Scene Understanding
CV and Pattern Recognition
Helps computers understand 3D scenes from many pictures.
All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles
CV and Pattern Recognition
Helps self-driving cars see and understand everything.
MMCD: Multi-Modal Collaborative Decision-Making for Connected Autonomy with Knowledge Distillation
Artificial Intelligence
Cars work together to avoid crashes better.