Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning
By: Hao Tan , Jun Lan , Zichang Tan and more
Potential Business Impact:
Finds fake videos even when they change.
Deepfake detection remains a formidable challenge due to the complex and evolving nature of fake content in real-world scenarios. However, existing academic benchmarks suffer from severe discrepancies from industrial practice, typically featuring homogeneous training sources and low-quality testing images, which hinder the practical deployments of current detectors. To mitigate this gap, we introduce HydraFake, a dataset that simulates real-world challenges with hierarchical generalization testing. Specifically, HydraFake involves diversified deepfake techniques and in-the-wild forgeries, along with rigorous training and evaluation protocol, covering unseen model architectures, emerging forgery techniques and novel data domains. Building on this resource, we propose Veritas, a multi-modal large language model (MLLM) based deepfake detector. Different from vanilla chain-of-thought (CoT), we introduce pattern-aware reasoning that involves critical reasoning patterns such as "planning" and "self-reflection" to emulate human forensic process. We further propose a two-stage training pipeline to seamlessly internalize such deepfake reasoning capacities into current MLLMs. Experiments on HydraFake dataset reveal that although previous detectors show great generalization on cross-model scenarios, they fall short on unseen forgeries and data domains. Our Veritas achieves significant gains across different OOD scenarios, and is capable of delivering transparent and faithful detection outputs.
Similar Papers
Do You See What I Say? Generalizable Deepfake Detection based on Visual Speech Recognition
CV and Pattern Recognition
Finds fake videos by watching lips move.
Combating Digitally Altered Images: Deepfake Detection
CV and Pattern Recognition
Finds fake pictures and videos made by computers.
TruthLens:A Training-Free Paradigm for DeepFake Detection
CV and Pattern Recognition
Finds fake pictures and explains why.