Physics-Aware Human-Object Rendering from Sparse Views via 3D Gaussian Splatting
By: Weiquan Wang , Jun Xiao , Yueting Zhuang and more
Potential Business Impact:
Makes computer videos show people touching things realistically.
Rendering realistic human-object interactions (HOIs) from sparse-view inputs is challenging due to occlusions and incomplete observations, yet crucial for various real-world applications. Existing methods always struggle with either low rendering qualities (\eg, visual fidelity and physically plausible HOIs) or high computational costs. To address these limitations, we propose HOGS (Human-Object Rendering via 3D Gaussian Splatting), a novel framework for efficient and physically plausible HOI rendering from sparse views. Specifically, HOGS combines 3D Gaussian Splatting with a physics-aware optimization process. It incorporates a Human Pose Refinement module for accurate pose estimation and a Sparse-View Human-Object Contact Prediction module for efficient contact region identification. This combination enables coherent joint rendering of human and object Gaussians while enforcing physically plausible interactions. Extensive experiments on the HODome dataset demonstrate that HOGS achieves superior rendering quality, efficiency, and physical plausibility compared to existing methods. We further show its extensibility to hand-object grasp rendering tasks, presenting its broader applicability to articulated object interactions.
Similar Papers
HoGS: Unified Near and Far Object Reconstruction via Homogeneous Gaussian Splatting
Graphics
Makes 3D pictures of far-away things look better.
RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Images
CV and Pattern Recognition
Makes 3D models of people from few pictures.
Persistent Object Gaussian Splat (POGS) for Tracking Human and Robot Manipulation of Irregularly Shaped Objects
Robotics
Robots can now grab and move weird objects.