StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Models
By: Haoxin Yang , Bangzhen Liu , Xuemiao Xu and more
Potential Business Impact:
Protects AI art from being copied or changed.
The advancement of diffusion models has enhanced the realism of AI-generated content but also raised concerns about misuse, necessitating robust copyright protection and tampering localization. Although recent methods have made progress toward unified solutions, their reliance on post hoc processing introduces considerable application inconvenience and compromises forensic reliability. We propose StableGuard, a novel framework that seamlessly integrates a binary watermark into the diffusion generation process, ensuring copyright protection and tampering localization in Latent Diffusion Models through an end-to-end design. We develop a Multiplexing Watermark VAE (MPW-VAE) by equipping a pretrained Variational Autoencoder (VAE) with a lightweight latent residual-based adapter, enabling the generation of paired watermarked and watermark-free images. These pairs, fused via random masks, create a diverse dataset for training a tampering-agnostic forensic network. To further enhance forensic synergy, we introduce a Mixture-of-Experts Guided Forensic Network (MoE-GFN) that dynamically integrates holistic watermark patterns, local tampering traces, and frequency-domain cues for precise watermark verification and tampered region detection. The MPW-VAE and MoE-GFN are jointly optimized in a self-supervised, end-to-end manner, fostering a reciprocal training between watermark embedding and forensic accuracy. Extensive experiments demonstrate that StableGuard consistently outperforms state-of-the-art methods in image fidelity, watermark verification, and tampering localization.
Similar Papers
GenPTW: In-Generation Image Watermarking for Provenance Tracing and Tamper Localization
Cryptography and Security
Adds invisible marks to AI pictures to prove they are real.
Visual Watermarking in the Era of Diffusion Models: Advances and Challenges
CV and Pattern Recognition
Protects pictures from being copied without permission.
DualGuard: Dual-stream Large Language Model Watermarking Defense against Paraphrase and Spoofing Attack
Cryptography and Security
Protects AI writing from being faked or changed.