Capture and Interact: Rapid 3D Object Acquisition and Rendering with Gaussian Splatting in Unity
By: Islomjon Shukhratov, Sergey Gorinsky
Potential Business Impact:
Turns phone videos into 3D models instantly.
Capturing and rendering three-dimensional (3D) objects in real time remain a significant challenge, yet hold substantial potential for applications in augmented reality, digital twin systems, remote collaboration and prototyping. We present an end-to-end pipeline that leverages 3D Gaussian Splatting (3D GS) to enable rapid acquisition and interactive rendering of real-world objects using a mobile device, cloud processing and a local computer. Users scan an object with a smartphone video, upload it for automated 3D reconstruction, and visualize it interactively in Unity at an average of 150 frames per second (fps) on a laptop. The system integrates mobile capture, cloud-based 3D GS and Unity rendering to support real-time telepresence. Our experiments show that the pipeline processes scans in approximately 10 minutes on a graphics processing unit (GPU) achieving real-time rendering on the laptop.
Similar Papers
GSAC: Leveraging Gaussian Splatting for Photorealistic Avatar Creation with Unity Integration
Graphics
Creates realistic virtual people from one video.
GauRast: Enhancing GPU Triangle Rasterizers to Accelerate 3D Gaussian Splatting
Graphics
Makes 3D pictures faster on phones.
A Fast Volumetric Capture and Reconstruction Pipeline for Dynamic Point Clouds and Gaussian Splats
Graphics
Creates 3D models from photos and depth.