VizDefender: Unmasking Visualization Tampering through Proactive Localization and Intent Inference
By: Sicheng Song , Yanjie Zhang , Zixin Chen and more
The integrity of data visualizations is increasingly threatened by image editing techniques that enable subtle yet deceptive tampering. Through a formative study, we define this challenge and categorize tampering techniques into two primary types: data manipulation and visual encoding manipulation. To address this, we present VizDefender, a framework for tampering detection and analysis. The framework integrates two core components: 1) a semi-fragile watermark module that protects the visualization by embedding a location map to images, which allows for the precise localization of tampered regions while preserving visual quality, and 2) an intent analysis module that leverages Multimodal Large Language Models (MLLMs) to interpret manipulation, inferring the attacker's intent and misleading effects. Extensive evaluations and user studies demonstrate the effectiveness of our methods.
Similar Papers
Security through the Eyes of AI: How Visualization is Shaping Malware Detection
Cryptography and Security
Shows bad computer programs using pictures.
Detecting Visual Information Manipulation Attacks in Augmented Reality: A Multimodal Semantic Reasoning Approach
CV and Pattern Recognition
Stops fake digital things from tricking AR users.
Beyond Pixels: Semantic-aware Typographic Attack for Geo-Privacy Protection
CV and Pattern Recognition
Hides your location from AI looking at pictures.