Towards Generalizable Deepfake Detection with Spatial-Frequency Collaborative Learning and Hierarchical Cross-Modal Fusion
By: Mengyu Qiao, Runze Tian, Yang Wang
Potential Business Impact:
Finds fake videos better, even new kinds.
The rapid evolution of deep generative models poses a critical challenge to deepfake detection, as detectors trained on forgery-specific artifacts often suffer significant performance degradation when encountering unseen forgeries. While existing methods predominantly rely on spatial domain analysis, frequency domain operations are primarily limited to feature-level augmentation, leaving frequency-native artifacts and spatial-frequency interactions insufficiently exploited. To address this limitation, we propose a novel detection framework that integrates multi-scale spatial-frequency analysis for universal deepfake detection. Our framework comprises three key components: (1) a local spectral feature extraction pipeline that combines block-wise discrete cosine transform with cascaded multi-scale convolutions to capture subtle spectral artifacts; (2) a global spectral feature extraction pipeline utilizing scale-invariant differential accumulation to identify holistic forgery distribution patterns; and (3) a multi-stage cross-modal fusion mechanism that incorporates shallow-layer attention enhancement and deep-layer dynamic modulation to model spatial-frequency interactions. Extensive evaluations on widely adopted benchmarks demonstrate that our method outperforms state-of-the-art deepfake detection methods in both accuracy and generalizability.
Similar Papers
A Spatial-Frequency Aware Multi-Scale Fusion Network for Real-Time Deepfake Detection
CV and Pattern Recognition
Finds fake videos fast, even on phones.
Beyond Spatial Frequency: Pixel-wise Temporal Frequency-based Deepfake Video Detection
CV and Pattern Recognition
Finds fake videos by spotting weird movements.
Dual-Branch Convolutional Framework for Spatial and Frequency-Based Image Forgery Detection
Machine Learning (CS)
Finds fake pictures by looking at details.