Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videos
By: Laura Pedrouzo-Rodriguez , Pedro Delgado-DeRobles , Luis F. Gomez and more
Potential Business Impact:
Stops fake avatars by checking unique face movements.
Photorealistic talking-head avatars are becoming increasingly common in virtual meetings, gaming, and social platforms. These avatars allow for more immersive communication, but they also introduce serious security risks. One emerging threat is impersonation: an attacker can steal a user's avatar-preserving their appearance and voice-making it nearly impossible to detect its fraudulent usage by sight or sound alone. In this paper, we explore the challenge of biometric verification in such avatar-mediated scenarios. Our main question is whether an individual's facial motion patterns can serve as reliable behavioral biometrics to verify their identity when the avatar's visual appearance is a facsimile of its owner. To answer this question, we introduce a new dataset of realistic avatar videos created using a state-of-the-art one-shot avatar generation model, GAGAvatar, with genuine and impostor avatar videos. We also propose a lightweight, explainable spatio-temporal Graph Convolutional Network architecture with temporal attention pooling, that uses only facial landmarks to model dynamic facial gestures. Experimental results demonstrate that facial motion cues enable meaningful identity verification with AUC values approaching 80%. The proposed benchmark and biometric system are available for the research community in order to bring attention to the urgent need for more advanced behavioral biometric defenses in avatar-based communication systems.
Similar Papers
Is It Really You? Exploring Biometric Verification Scenarios in Photorealistic Talking-Head Avatar Videos
CV and Pattern Recognition
Detects fake talking avatars by watching faces.
Deep Learning Models for Robust Facial Liveness Detection
CV and Pattern Recognition
Stops fake faces from tricking security cameras.
Robust Face Liveness Detection for Biometric Authentication using Single Image
CV and Pattern Recognition
Stops fake faces from tricking security systems.