All Patches Matter, More Patches Better: Enhance AI-Generated Image Detection via Panoptic Patch Learning
By: Zheng Yang , Ruoxin Chen , Zhiyuan Yan and more
Potential Business Impact:
Finds fake pictures by looking at all the pieces.
The exponential growth of AI-generated images (AIGIs) underscores the urgent need for robust and generalizable detection methods. In this paper, we establish two key principles for AIGI detection through systematic analysis: (1) All Patches Matter: Unlike conventional image classification where discriminative features concentrate on object-centric regions, each patch in AIGIs inherently contains synthetic artifacts due to the uniform generation process, suggesting that every patch serves as an important artifact source for detection. (2) More Patches Better: Leveraging distributed artifacts across more patches improves detection robustness by capturing complementary forensic evidence and reducing over-reliance on specific patches, thereby enhancing robustness and generalization. However, our counterfactual analysis reveals an undesirable phenomenon: naively trained detectors often exhibit a Few-Patch Bias, discriminating between real and synthetic images based on minority patches. We identify Lazy Learner as the root cause: detectors preferentially learn conspicuous artifacts in limited patches while neglecting broader artifact distributions. To address this bias, we propose the Panoptic Patch Learning (PPL) framework, involving: (1) Random Patch Replacement that randomly substitutes synthetic patches with real counterparts to compel models to identify artifacts in underutilized regions, encouraging the broader use of more patches; (2) Patch-wise Contrastive Learning that enforces consistent discriminative capability across all patches, ensuring uniform utilization of all patches. Extensive experiments across two different settings on several benchmarks verify the effectiveness of our approach.
Similar Papers
Scaling Up AI-Generated Image Detection via Generator-Aware Prototypes
CV and Pattern Recognition
Finds fake pictures better, even from new tools.
IPG: Incremental Patch Generation for Generalized Adversarial Patch Training
CV and Pattern Recognition
Makes AI see fake things to get stronger.
Is Artificial Intelligence Generated Image Detection a Solved Problem?
CV and Pattern Recognition
Finds fake pictures made by computers.