MATCHING AUDIO TO A STATE-SPACE MODEL FOR PSEUDORANDOM ANIMATION

Patent №

US 11,282,253

Granted

2022-03-22

Filed 2019

Owner

SNAP INC.

Lab

AI components

2

speech · evo

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16588329

Methods, devices, media, and other embodiments are described for generating pseudorandom animations matched to audio data on a device. In one embodiment a video is generated and output on a display of the device using a computer animation model. Audio is detected from a microphone of the device, and the audio data is processed to determine a set of audio characteristics for the audio data received at the microphone of the device. A first motion state is randomly selected from the plurality of motion states, one or more motion values of the first motion state are generated using the set of audio characteristics, and the video is updated using the one or more motion values with the computer animation model to create an animated action within the video.

SpeechEvolutionary computationG06T 13/205G06T 13/80G06T 19/006G10L 25/57

AI classification

Speech0.99
Evolutionary computation0.99
Vision0.48
AI hardware0.24
Machine learning0.11
Knowledge representation0.06
Natural language0.02
Planning0.01

Ownership

SNAP INC.

assignment · 564270402

Assignors

GORUMKONDA, GURUNANDAN KRISHNAN, NAYAR, SHREE K.

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC