Your Text Encoder Can Be An Object-Level Watermarking Controller
By: Naresh Kumar Devulapally , Mingzhen Huang , Vishal Asnani and more
Potential Business Impact:
Marks AI pictures so you know they're fake.
Invisible watermarking of AI-generated images can help with copyright protection, enabling detection and identification of AI-generated media. In this work, we present a novel approach to watermark images of T2I Latent Diffusion Models (LDMs). By only fine-tuning text token embeddings $W_*$, we enable watermarking in selected objects or parts of the image, offering greater flexibility compared to traditional full-image watermarking. Our method leverages the text encoder's compatibility across various LDMs, allowing plug-and-play integration for different LDMs. Moreover, introducing the watermark early in the encoding stage improves robustness to adversarial perturbations in later stages of the pipeline. Our approach achieves $99\%$ bit accuracy ($48$ bits) with a $10^5 \times$ reduction in model parameters, enabling efficient watermarking.
Similar Papers
Fast, Secure, and High-Capacity Image Watermarking with Autoencoded Text Vectors
Cryptography and Security
Hides full sentences in pictures, not just bits.
Yet Another Watermark for Large Language Models
Cryptography and Security
Marks computer writing so you know it's real.
Yet Another Watermark for Large Language Models
Cryptography and Security
Marks AI writing so you know it's from a machine.