Score: 1

RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflection

Published: July 10, 2025 | arXiv ID: 2507.07733v1

By: Yongyang Zhou , Fang-Lue Zhang , Zichen Wang and more

Potential Business Impact:

Makes shiny objects look real in computer pictures.

Business Areas:
3D Technology Hardware, Software

3D Gaussian Splatting (3DGS) has demonstrated impressive capabilities in novel view synthesis. However, rendering reflective objects remains a significant challenge, particularly in inverse rendering and relighting. We introduce RTR-GS, a novel inverse rendering framework capable of robustly rendering objects with arbitrary reflectance properties, decomposing BRDF and lighting, and delivering credible relighting results. Given a collection of multi-view images, our method effectively recovers geometric structure through a hybrid rendering model that combines forward rendering for radiance transfer with deferred rendering for reflections. This approach successfully separates high-frequency and low-frequency appearances, mitigating floating artifacts caused by spherical harmonic overfitting when handling high-frequency details. We further refine BRDF and lighting decomposition using an additional physically-based deferred rendering branch. Experimental results show that our method enhances novel view synthesis, normal estimation, decomposition, and relighting while maintaining efficient training inference process.

Country of Origin
🇳🇿 🇨🇳 China, New Zealand

Page Count
16 pages

Category
Computer Science:
Graphics