Does Head Pose Correction Improve Biometric Facial Recognition?
By: Justin Norman, Hany Farid
Potential Business Impact:
Fixes blurry face pictures for better ID.
Biometric facial recognition models often demonstrate significant decreases in accuracy when processing real-world images, often characterized by poor quality, non-frontal subject poses, and subject occlusions. We investigate whether targeted, AI-driven, head-pose correction and image restoration can improve recognition accuracy. Using a model-agnostic, large-scale, forensic-evaluation pipeline, we assess the impact of three restoration approaches: 3D reconstruction (NextFace), 2D frontalization (CFR-GAN), and feature enhancement (CodeFormer). We find that naive application of these techniques substantially degrades facial recognition accuracy. However, we also find that selective application of CFR-GAN combined with CodeFormer yields meaningful improvements.
Similar Papers
Towards Large-Scale Pose-Invariant Face Recognition Using Face Defrontalization
CV and Pattern Recognition
Helps computers recognize faces from any angle.
Realism to Deception: Investigating Deepfake Detectors Against Face Enhancement
CV and Pattern Recognition
Makes fake faces harder to spot.
Bringing Your Portrait to 3D Presence
CV and Pattern Recognition
Turns one photo into a moving 3D person.