Evaluating Fisheye-Compatible 3D Gaussian Splatting Methods on Real Images Beyond 180 Degree Field of View
By: Ulas Gunes , Matias Turkulainen , Juho Kannala and more
Potential Business Impact:
Creates 3D worlds from super-wide photos.
We present the first evaluation of fisheye-based 3D Gaussian Splatting methods, Fisheye-GS and 3DGUT, on real images with fields of view exceeding 180 degree. Our study covers both indoor and outdoor scenes captured with 200 degree fisheye cameras and analyzes how each method handles extreme distortion in real world settings. We evaluate performance under varying fields of view (200 degree, 160 degree, and 120 degree) to study the tradeoff between peripheral distortion and spatial coverage. Fisheye-GS benefits from field of view (FoV) reduction, particularly at 160 degree, while 3DGUT remains stable across all settings and maintains high perceptual quality at the full 200 degree view. To address the limitations of SfM-based initialization, which often fails under strong distortion, we also propose a depth-based strategy using UniK3D predictions from only 2-3 fisheye images per scene. Although UniK3D is not trained on real fisheye data, it produces dense point clouds that enable reconstruction quality on par with SfM, even in difficult scenes with fog, glare, or sky. Our results highlight the practical viability of fisheye-based 3DGS methods for wide-angle 3D reconstruction from sparse and distortion-heavy image inputs.
Similar Papers
Seam360GS: Seamless 360° Gaussian Splatting from Real-World Omnidirectional Images
CV and Pattern Recognition
Fixes blurry 360-degree pictures for VR.
Exploring Surround-View Fisheye Camera 3D Object Detection
CV and Pattern Recognition
Helps cars see better with special cameras.
Online 3D Gaussian Splatting Modeling with Novel View Selection
CV and Pattern Recognition
Creates more complete 3D models from fewer pictures.