PrivLEX: Detecting legal concepts in images through Vision-Language Models
By: Darya Baranouskaya, Andrea Cavallaro
We present PrivLEX, a novel image privacy classifier that grounds its decisions in legally defined personal data concepts. PrivLEX is the first interpretable privacy classifier aligned with legal concepts that leverages the recognition capabilities of Vision-Language Models (VLMs). PrivLEX relies on zero-shot VLM concept detection to provide interpretable classification through a label-free Concept Bottleneck Model, without requiring explicit concept labels during training. We demonstrate PrivLEX's ability to identify personal data concepts that are present in images. We further analyse the sensitivity of such concepts as perceived by human annotators of image privacy datasets.
Similar Papers
Zero-shot image privacy classification with Vision-Language Models
CV and Pattern Recognition
Makes computers better at guessing private pictures.
MultiPriv: Benchmarking Individual-Level Privacy Reasoning in Vision-Language Models
CV and Pattern Recognition
Finds AI that spies on people using pictures.
Who Can See Through You? Adversarial Shielding Against VLM-Based Attribute Inference Attacks
CV and Pattern Recognition
Protects your photos from being spied on by AI.