GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatar
By: SeungJun Moon , Hah Min Lew , Seungeun Lee and more
Potential Business Impact:
Makes 3D faces move realistically without losing their look.
Despite recent progress in 3D head avatar generation, balancing identity preservation, i.e., reconstruction, with novel poses and expressions, i.e., animation, remains a challenge. Existing methods struggle to adapt Gaussians to varying geometrical deviations across facial regions, resulting in suboptimal quality. To address this, we propose GeoAvatar, a framework for adaptive geometrical Gaussian Splatting. GeoAvatar leverages Adaptive Pre-allocation Stage (APS), an unsupervised method that segments Gaussians into rigid and flexible sets for adaptive offset regularization. Then, based on mouth anatomy and dynamics, we introduce a novel mouth structure and the part-wise deformation strategy to enhance the animation fidelity of the mouth. Finally, we propose a regularization loss for precise rigging between Gaussians and 3DMM faces. Moreover, we release DynamicFace, a video dataset with highly expressive facial motions. Extensive experiments show the superiority of GeoAvatar compared to state-of-the-art methods in reconstruction and novel animation scenarios.
Similar Papers
EAvatar: Expression-Aware Head Avatar Reconstruction with Generative Geometry Priors
CV and Pattern Recognition
Makes virtual faces look and move more real.
AHA! Animating Human Avatars in Diverse Scenes with Gaussian Splatting
CV and Pattern Recognition
Makes animated people look real in 3D videos.
AvatarBack: Back-Head Generation for Complete 3D Avatars from Front-View Images
CV and Pattern Recognition
Makes 3D head models look real from all sides.