Text-driven 3D avatar animation has been an essential part of virtual human techniques, which has a wide range of applications in movie, digital games and video streaming. In this work, we introduce a practical system which drives both facial and body movements of 3D avatar by text input. Our proposed system first converts text input to speech signal and conducts text analysis to extract semantic tags simultaneously. Then we generate the lip movements from the synthetic speech, and meanwhile facial expression and body movement are generated by the joint modeling of speech and textual information, which can drive our virtual 3D avatar talking and acting like a real human.
Paper
Full text
Text-driven 3D Avatar Animation with Emotional and Expressive Behaviors
Semantic Scholar · Computer Science · 2021
Abstract
Text-driven 3D avatar animation has been an essential part of virtual human techniques, which has a wide range of applications in movie, digital games and video streaming. In this work, we introduce a practical system which drives both facial and body movements of 3D avatar by text input. Our proposed system first converts text input to speech signal and conducts text analysis to extract semantic tags simultaneously. Then we generate the lip movements from the synthetic speech, and meanwhile facial expression and body movement are generated by the joint modeling of speech and textual information, which can drive our virtual 3D avatar talking and acting like a real human.