Patent №
US 7,689,413
Granted
2010-03-30
Filed 2007
Owner
MICROSOFT CORPORATION
Lab
AI components
5
ml · nlp · vision · speech · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
11852961
A system and method facilitating speech detection and/or enhancement utilizing audio/video fusion is provided. The present invention fuses audio and video in a probabilistic generative model that implements cross-model, self-supervised learning, enabling rapid adaptation to audio visual data. The system can learn to detect and enhance speech in noise given only a short (e.g., 30 second) sequence of audio-visual data. In addition, it automatically learns to track the lips as they move around in the video.
AI classification
Ownership
MICROSOFT CORPORATION
assignment · 198750498
Assignors
HERSHEY, JOHN R., KRISTJANSSON, TRAUSTI THOR, ATTIAS, HAGAI, JOJIC, NEBOJSA
On an employer assignment, the assignors are typically the inventors.