GaitCrafter: Diffusion Model for Biometric Preserving Gait Synthesis
By: Sirshapan Mitra, Yogesh S. Rawat
Potential Business Impact:
Makes computers recognize people by how they walk.
Gait recognition is a valuable biometric task that enables the identification of individuals from a distance based on their walking patterns. However, it remains limited by the lack of large-scale labeled datasets and the difficulty of collecting diverse gait samples for each individual while preserving privacy. To address these challenges, we propose GaitCrafter, a diffusion-based framework for synthesizing realistic gait sequences in the silhouette domain. Unlike prior works that rely on simulated environments or alternative generative models, GaitCrafter trains a video diffusion model from scratch, exclusively on gait silhouette data. Our approach enables the generation of temporally consistent and identity-preserving gait sequences. Moreover, the generation process is controllable-allowing conditioning on various covariates such as clothing, carried objects, and view angle. We show that incorporating synthetic samples generated by GaitCrafter into the gait recognition pipeline leads to improved performance, especially under challenging conditions. Additionally, we introduce a mechanism to generate novel identities-synthetic individuals not present in the original dataset-by interpolating identity embeddings. These novel identities exhibit unique, consistent gait patterns and are useful for training models while maintaining privacy of real subjects. Overall, our work takes an important step toward leveraging diffusion models for high-quality, controllable, and privacy-aware gait data generation.
Similar Papers
Gait Recognition via Collaborating Discriminative and Generative Diffusion Models
CV and Pattern Recognition
Identifies people by how they walk.
TrackletGait: A Robust Framework for Gait Recognition in the Wild
CV and Pattern Recognition
Identifies people by how they walk, even in crowds.
Silhouette-based Gait Foundation Model
CV and Pattern Recognition
Lets computers recognize people by how they walk.