Patent №
US 9,280,972
Granted
2016-03-08
Filed 2013
Owner
MICROSOFT CORPORATION
Lab
AI components
4
ml · nlp · vision · speech
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
13892094
Embodiments that relate to converting audio inputs from an environment into text are disclosed. For example, in one disclosed embodiment a speech conversion program receives audio inputs from a microphone array of a head-mounted display device. Image data is captured from the environment, and one or more possible faces are detected from image data. Eye-tracking data is used to determine a target face on which a user is focused. A beamforming technique is applied to at least a portion of the audio inputs to identify target audio inputs that are associated with the target face. The target audio inputs are converted into text that is displayed via a transparent display of the head-mounted display device.
AI classification
Ownership
MICROSOFT CORPORATION
assignment · 365950053
Assignors
MCCULLOCH, DANIEL, LEE, ABBY LIN, SMITH-KIPNIS, ADAM BENJAMIN, PLUMB, JONATHAN WILLIAM, DAVID, ALEXANDRE, HALE, MICHAEL O., COLE, JEFF, LANGERAK, HENDRIK MARK
On an employer assignment, the assignors are typically the inventors.