Beyond Flicker: Detecting Kinematic Inconsistencies for Generalizable Deepfake Video Detection
By: Alejandro Cobo , Roberto Valle , José Miguel Buenaposada and more
Potential Business Impact:
Spots fake videos by finding weird face movements.
Generalizing deepfake detection to unseen manipulations remains a key challenge. A recent approach to tackle this issue is to train a network with pristine face images that have been manipulated with hand-crafted artifacts to extract more generalizable clues. While effective for static images, extending this to the video domain is an open issue. Existing methods model temporal artifacts as frame-to-frame instabilities, overlooking a key vulnerability: the violation of natural motion dependencies between different facial regions. In this paper, we propose a synthetic video generation method that creates training data with subtle kinematic inconsistencies. We train an autoencoder to decompose facial landmark configurations into motion bases. By manipulating these bases, we selectively break the natural correlations in facial movements and introduce these artifacts into pristine videos via face morphing. A network trained on our data learns to spot these sophisticated biomechanical flaws, achieving state-of-the-art generalization results on several popular benchmarks.
Similar Papers
Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localization
CV and Pattern Recognition
Finds fake videos by predicting what happens next.
Improving Generalization in Deepfake Detection with Face Foundation Models and Metric Learning
CV and Pattern Recognition
Finds fake videos even when they look real.
Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos
CV and Pattern Recognition
Checks if fake human videos look real.