Patent №
US 11,551,664
Granted
2023-01-10
Filed 2022
Owner
DEEP MEDIA INC.
Lab
—
AI components
5
ml · nlp · vision · speech · kr
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
17737546
A system and method for translating audio, and video when desired. The translations include synthetic media and data generated using AI systems. Through unique processors and generators executing a unique sequence of steps, the system and method produces more accurate translations that can account for various speech characteristics (e.g., emotion, pacing, idioms, sarcasm, jokes, tone, phonemes, etc.). These speech characteristics are identified in the input media and synthetically incorporated into the translated outputs to mirror the characteristics in the input media. Some embodiments further include systems and methods that manipulate the input video such that the speakers' faces and/or lips appear as if they are natively speaking the generated audio.
AI classification
Ownership
DEEP MEDIA INC.
assignment · 599480048
Assignors
GUPTA, RIJUL, BROWN, EMMA
On an employer assignment, the assignors are typically the inventors.