Robust AI-Generated Face Detection with Imbalanced Data
By: Yamini Sri Krubha , Aryana Hou , Braden Vester and more
Potential Business Impact:
Finds fake videos even when they look real.
Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats to digital trust. Current deepfake detection techniques have evolved from CNN-based methods focused on local artifacts to more advanced approaches using vision transformers and multimodal models like CLIP, which capture global anomalies and improve cross-domain generalization. Despite recent progress, state-of-the-art deepfake detectors still face major challenges in handling distribution shifts from emerging generative models and addressing severe class imbalance between authentic and fake samples in deepfake datasets, which limits their robustness and detection accuracy. To address these challenges, we propose a framework that combines dynamic loss reweighting and ranking-based optimization, which achieves superior generalization and performance under imbalanced dataset conditions. The code is available at https://github.com/Purdue-M2/SP_CUP.
Similar Papers
A Deep Learning Approach for Facial Attribute Manipulation and Reconstruction in Surveillance and Reconnaissance
CV and Pattern Recognition
Makes face recognition work better for everyone.
Evaluating Deepfake Detectors in the Wild
CV and Pattern Recognition
Finds fake videos that fool most detection tools.
Combating Digitally Altered Images: Deepfake Detection
CV and Pattern Recognition
Finds fake pictures and videos made by computers.