Ordinality of Visible-Thermal Image Intensities for Intrinsic Image Decomposition
By: Zeqing Leo Yuan , Mani Ramanagopal , Aswin C. Sankaranarayanan and more
Potential Business Impact:
Shows objects' true colors and shadows using heat.
Decomposing an image into its intrinsic photometric factors--shading and reflectance--is a long-standing challenge due to the lack of extensive ground-truth data for real-world scenes. Recent methods rely on synthetic data or sparse annotations for limited indoor and even fewer outdoor scenes. We introduce a novel training-free approach for intrinsic image decomposition using only a pair of visible and thermal images. We leverage the principle that light not reflected from an opaque surface is absorbed and detected as heat by a thermal camera. This allows us to relate the ordinalities between visible and thermal image intensities to the ordinalities of shading and reflectance, which can densely self-supervise an optimizing neural network to recover shading and reflectance. We perform quantitative evaluations with known reflectance and shading under natural and artificial lighting, and qualitative experiments across diverse outdoor scenes. The results demonstrate superior performance over recent learning-based models and point toward a scalable path to curating real-world ordinal supervision, previously infeasible via manual labeling.
Similar Papers
Texture-aware Intrinsic Image Decomposition with Model- and Learning-based Priors
CV and Pattern Recognition
Separates object colors from lighting in photos.
Objective, Absolute and Hue-aware Metrics for Intrinsic Image Decomposition on Real-World Scenes: A Proof of Concept
CV and Pattern Recognition
Makes computer pictures show true colors and light.
IDT: A Physically Grounded Transformer for Feed-Forward Multi-View Intrinsic Decomposition
CV and Pattern Recognition
Makes pictures look the same from different angles.