No Vision, No Wearables: 5G-based 2D Human Pose Recognition with Integrated Sensing and Communications
By: Haojin Li , Dongzhe Li , Anbang Zhang and more
With the increasing maturity of contactless human pose recognition (HPR) technology, indoor interactive applications have raised higher demands for natural, controller-free interaction methods. However, current mainstream HPR solutions relying on vision or radio-frequency (RF) (including WiFi, radar) still face various challenges in practical deployment, such as privacy concerns, susceptibility to occlusion, dedicated equipment and functions, and limited sensing resolution and range. 5G-based integrated sensing and communication (ISAC) technology, by merging communication and sensing functions, offers a new approach to address these challenges in contactless HPR. We propose a practical 5G-based ISAC system capable of inferring 2D HPR from uplink sounding reference signals (SRS). Specifically, rich features are extracted from multiple domains and employ an encoder to achieve unified alignment and representation in a latent space. Subsequently, low-dimensional features are fused to output the human pose state. Experimental results demonstrate that in typical indoor environments, our proposed 5G-based ISAC HPR system significantly outperforms current mainstream baseline solutions in HPR performance, providing a solid technical foundation for universal human-computer interaction.
Similar Papers
Integrated Sensing and Communication for 6G Holographic Digital Twins
Multimedia
Creates real-life 3D copies for virtual worlds.
Programmable and GPU-Accelerated Edge Inference for Real-Time ISAC on NVIDIA ARC-OTA
Networking and Internet Architecture
Lets phones find people indoors using phone signals.
MULTI-SCOUT: Multistatic Integrated Sensing and Communications in 5G and Beyond for Moving Target Detection, Positioning, and Tracking
Networking and Internet Architecture
Lets 5G signals find and track moving things.