SPEECH-DRIVEN FACIAL ANIMATION GENERATION METHOD

Patent №

US 11,354,841

Granted

2022-06-07

Filed 2021

Owner

ZHEJIANG UNIVERSITY

+1 more

Lab

AI components

5

ml · nlp · vision · speech · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17214936

The present disclosure discloses a speech-driven facial animation generation method. The method is mainly divided into six steps: extracting speech features, collecting frequency information, summarizing time information, decoding action features, driving a facial model, and sliding a signal window. The present disclosure can drive, according to an input speech audio signal, any facial model in real time under a particular delay to generate animation. The quality of the animation reaches the currently most advanced speech animation technology level, and has the characteristics of light weight and good robustness. The present disclosure can be used to generate speech animation under different scenes, such as VR virtual social networking, and virtual speech assistants and games.

Machine learningNatural languageVisionSpeechAI hardwareG06T 13/205G10L 21/10G06T 13/40G10L 25/18G10L 25/24G10L 25/30G10L 2021/105

AI classification

Speech1.00
Natural language1.00
AI hardware0.99
Vision0.99
Machine learning0.99
Evolutionary computation0.02
Planning0.00
Knowledge representation0.00

Ownership

ZHEJIANG UNIVERSITY

assignment · 565060624

FACEUNITY TECHNOLOGY CO.,LTD.

assignment · 565060624

Assignors

ZHOU, KUN, CHAI, YUJIN, WENG, YANLIN, WANG, LVDI

On an employer assignment, the assignors are typically the inventors.

From the same owner

© 2026 NYSGPT2525 LLC