LoRA-Enhanced Vision Transformer for Single Image based Morphing Attack Detection via Knowledge Distillation from EfficientNet
By: Ria Shekhawat , Sushrut Patwardhan , Raghavendra Ramachandra and more
Potential Business Impact:
Stops fake faces from fooling security cameras.
Face Recognition Systems (FRS) are critical for security but remain vulnerable to morphing attacks, where synthetic images blend biometric features from multiple individuals. We propose a novel Single-Image Morphing Attack Detection (S-MAD) approach using a teacher-student framework, where a CNN-based teacher model refines a ViT-based student model. To improve efficiency, we integrate Low-Rank Adaptation (LoRA) for fine-tuning, reducing computational costs while maintaining high detection accuracy. Extensive experiments are conducted on a morphing dataset built from three publicly available face datasets, incorporating ten different morphing generation algorithms to assess robustness. The proposed method is benchmarked against six state-of-the-art S-MAD techniques, demonstrating superior detection performance and computational efficiency.
Similar Papers
Generalized Single-Image-Based Morphing Attack Detection Using Deep Representations from Vision Transformer
CV and Pattern Recognition
Stops fake faces from fooling security systems.
Towards Minimal Fine-Tuning of VLMs
CV and Pattern Recognition
Makes AI understand pictures and text better, faster.
LoRA as a Flexible Framework for Securing Large Vision Systems
CV and Pattern Recognition
Fixes self-driving cars fooled by fake signs.