DEVICE AND METHOD FOR GENERATING TEXT REPRESENTATIVE OF LIP MOVEMENT

Patent №

US 10,522,147

Granted

2019-12-31

Filed 2017

Owner

MOTOROLA SOLUTIONS, INC.

Lab

AI components

3

nlp · vision · speech

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

15850814

A device and method for generating text representative of lip movement is provided. One or more portions of video data are determined that include: audio with an intelligibility rating below a threshold intelligibility rating; and lips of a human face. A lip-reading algorithm is applied to the one or more portions of the video data to determine text representative of detected lip movement in the one or more portions of the video data. The text representative of the detected lip movement is stored in a memory. A transcript that includes the text representative of the detected lip movement may be generated. Captioned video data may be generated from the video data and the text representative of detected lip movement.

Natural languageVisionSpeechG10L 15/25G06V 20/40G06V 40/20G10L 15/26G10L 25/57G10L 25/60

AI classification

Natural language1.00
Vision1.00
Speech1.00
AI hardware0.34
Planning0.03
Knowledge representation0.02
Machine learning0.00
Evolutionary computation0.00

Ownership

MOTOROLA SOLUTIONS, INC.

assignment · 446910692

Assignors

VARNER, STEPHEN, LIN, WEI, EKL, RANDY L., LAW, DANIEL A.

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC