AUDIO AND VIDEO TRANSLATOR

Patent №

US 11,551,664

Granted

2023-01-10

Filed 2022

Owner

DEEP MEDIA INC.

Lab

AI components

5

ml · nlp · vision · speech · kr

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17737546

A system and method for translating audio, and video when desired. The translations include synthetic media and data generated using AI systems. Through unique processors and generators executing a unique sequence of steps, the system and method produces more accurate translations that can account for various speech characteristics (e.g., emotion, pacing, idioms, sarcasm, jokes, tone, phonemes, etc.). These speech characteristics are identified in the input media and synthetically incorporated into the translated outputs to mirror the characteristics in the input media. Some embodiments further include systems and methods that manipulate the input video such that the speakers' faces and/or lips appear as if they are natively speaking the generated audio.

Machine learningNatural languageVisionSpeechKnowledge representationG06F 40/30G10L 13/08G06F 40/103G06F 40/42G06T 7/20G06V 10/778G06V 40/171G10L 15/04+3 more

AI classification

Natural language1.00
Speech1.00
Machine learning0.97
Knowledge representation0.81
Vision0.54
AI hardware0.11
Planning0.01
Evolutionary computation0.00

Ownership

DEEP MEDIA INC.

assignment · 599480048

Assignors

GUPTA, RIJUL, BROWN, EMMA

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC