From Particles to Fields: Reframing Photon Mapping with Continuous Gaussian Photon Fields
By: Jiachen Tao , Benjamin Planche , Van Nguyen Nguyen and more
Potential Business Impact:
Makes computer pictures look real, faster.
Accurately modeling light transport is essential for realistic image synthesis. Photon mapping provides physically grounded estimates of complex global illumination effects such as caustics and specular-diffuse interactions, yet its per-view radiance estimation remains computationally inefficient when rendering multiple views of the same scene. The inefficiency arises from independent photon tracing and stochastic kernel estimation at each viewpoint, leading to inevitable redundant computation. To accelerate multi-view rendering, we reformulate photon mapping as a continuous and reusable radiance function. Specifically, we introduce the Gaussian Photon Field (GPF), a learnable representation that encodes photon distributions as anisotropic 3D Gaussian primitives parameterized by position, rotation, scale, and spectrum. GPF is initialized from physically traced photons in the first SPPM iteration and optimized using multi-view supervision of final radiance, distilling photon-based light transport into a continuous field. Once trained, the field enables differentiable radiance evaluation along camera rays without repeated photon tracing or iterative refinement. Extensive experiments on scenes with complex light transport, such as caustics and specular-diffuse interactions, demonstrate that GPF attains photon-level accuracy while reducing computation by orders of magnitude, unifying the physical rigor of photon-based rendering with the efficiency of neural scene representations.
Similar Papers
Differentiable Light Transport with Gaussian Surfels via Adapted Radiosity for Efficient Relighting and Geometry Reconstruction
Graphics
Makes 3D scenes look real with light.
GaussianUpdate: Continual 3D Gaussian Splatting Update for Changing Environments
CV and Pattern Recognition
Lets 3D scenes change without rebuilding them.
RF-PGS: Fully-structured Spatial Wireless Channel Representation with Planar Gaussian Splatting
CV and Pattern Recognition
Maps radio waves for faster wireless internet.