TruthLens:A Training-Free Paradigm for DeepFake Detection
By: Ritabrata Chakraborty , Rajatsubhra Chakraborty , Ali Khaleghi Rahimian and more
Potential Business Impact:
Finds fake pictures and explains why.
The proliferation of synthetic images generated by advanced AI models poses significant challenges in identifying and understanding manipulated visual content. Current fake image detection methods predominantly rely on binary classification models that focus on accuracy while often neglecting interpretability, leaving users without clear insights into why an image is deemed real or fake. To bridge this gap, we introduce TruthLens, a novel training-free framework that reimagines deepfake detection as a visual question-answering (VQA) task. TruthLens utilizes state-of-the-art large vision-language models (LVLMs) to observe and describe visual artifacts and combines this with the reasoning capabilities of large language models (LLMs) like GPT-4 to analyze and aggregate evidence into informed decisions. By adopting a multimodal approach, TruthLens seamlessly integrates visual and semantic reasoning to not only classify images as real or fake but also provide interpretable explanations for its decisions. This transparency enhances trust and provides valuable insights into the artifacts that signal synthetic content. Extensive evaluations demonstrate that TruthLens outperforms conventional methods, achieving high accuracy on challenging datasets while maintaining a strong emphasis on explainability. By reframing deepfake detection as a reasoning-driven process, TruthLens establishes a new paradigm in combating synthetic media, combining cutting-edge performance with interpretability to address the growing threats of visual disinformation.
Similar Papers
TruthLens: Visual Grounding for Universal DeepFake Reasoning
CV and Pattern Recognition
Finds fake videos by explaining why.
Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning
CV and Pattern Recognition
Finds fake videos even when they change.
ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detection
CV and Pattern Recognition
Finds fake pictures made by computers.