POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling
By: Zhuo Chen , Chengqun Yang , Zhuo Su and more
Potential Business Impact:
Changes how faces look in different lights.
Face relighting aims to synthesize realistic portraits under novel illumination while preserving identity and geometry. However, progress remains constrained by the limited availability of large-scale, physically consistent illumination data. To address this, we introduce POLAR, a large-scale and physically calibrated One-Light-at-a-Time (OLAT) dataset containing over 200 subjects captured under 156 lighting directions, multiple views, and diverse expressions. Building upon POLAR, we develop a flow-based generative model POLARNet that predicts per-light OLAT responses from a single portrait, capturing fine-grained and direction-aware illumination effects while preserving facial identity. Unlike diffusion or background-conditioned methods that rely on statistical or contextual cues, our formulation models illumination as a continuous, physically interpretable transformation between lighting states, enabling scalable and controllable relighting. Together, POLAR and POLARNet form a unified illumination learning framework that links real data, generative synthesis, and physically grounded relighting, establishing a self-sustaining "chicken-and-egg" cycle for scalable and reproducible portrait illumination.
Similar Papers
HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesis
CV and Pattern Recognition
Makes digital people look real in any light.
3DPR: Single Image 3D Portrait Relight using Generative Priors
CV and Pattern Recognition
Changes how a face looks in pictures with new lights.
Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset
Graphics
Changes video lighting after it's filmed.