Audio2Face-3D: Audio-driven Realistic Facial Animation For Digital Avatars
By: NVIDIA , : , Chaeyeon Chung and more
Potential Business Impact:
Makes cartoon faces move and talk like real people.
Audio-driven facial animation presents an effective solution for animating digital avatars. In this paper, we detail the technical aspects of NVIDIA Audio2Face-3D, including data acquisition, network architecture, retargeting methodology, evaluation metrics, and use cases. Audio2Face-3D system enables real-time interaction between human users and interactive avatars, facilitating facial animation authoring for game characters. To assist digital avatar creators and game developers in generating realistic facial animations, we have open-sourced Audio2Face-3D networks, SDK, training framework, and example dataset.
Similar Papers
Audio Driven Real-Time Facial Animation for Social Telepresence
Graphics
Makes virtual faces talk and move like real people.
Audio Driven Real-Time Facial Animation for Social Telepresence
Graphics
Makes virtual people talk and move like real ones.
3DiFACE: Synthesizing and Editing Holistic 3D Facial Animation
Graphics
Makes talking cartoon faces move realistically.