Patent №
US 11,354,841
Granted
2022-06-07
Filed 2021
Owner
ZHEJIANG UNIVERSITY
+1 more
Lab
—
AI components
5
ml · nlp · vision · speech · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
17214936
The present disclosure discloses a speech-driven facial animation generation method. The method is mainly divided into six steps: extracting speech features, collecting frequency information, summarizing time information, decoding action features, driving a facial model, and sliding a signal window. The present disclosure can drive, according to an input speech audio signal, any facial model in real time under a particular delay to generate animation. The quality of the animation reaches the currently most advanced speech animation technology level, and has the characteristics of light weight and good robustness. The present disclosure can be used to generate speech animation under different scenes, such as VR virtual social networking, and virtual speech assistants and games.
AI classification
Ownership
ZHEJIANG UNIVERSITY
assignment · 565060624
FACEUNITY TECHNOLOGY CO.,LTD.
assignment · 565060624
Assignors
ZHOU, KUN, CHAI, YUJIN, WENG, YANLIN, WANG, LVDI
On an employer assignment, the assignors are typically the inventors.