COMPOUND GESTURE-SPEECH COMMANDS

Patent №

US 8,296,151

Granted

2012-10-23

Filed 2010

Owner

MICROSOFT CORPORATION

AI components

5

ml · nlp · vision · speech · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

12818898

A multimedia entertainment system combines both gestures and voice commands to provide an enhanced control scheme. A user's body position or motion may be recognized as a gesture, and may be used to provide context to recognize user generated sounds, such as speech input. Likewise, speech input may be recognized as a voice command, and may be used to provide context to recognize a body position or motion as a gesture. Weights may be assigned to the inputs to facilitate processing. When a gesture is recognized, a limited set of voice commands associated with the recognized gesture are loaded for use. Further, additional sets of voice commands may be structured in a hierarchical manner such that speaking a voice command from one set of voice commands leads to the system loading a next set of voice commands.

Machine learningNatural languageVisionSpeechAI hardwareG06F 3/017G06F 3/038G06F 3/167G06F 2203/0381G06T 7/521G06V 40/107G10L 2015/223G10L 2015/226

AI classification

Speech1.00
AI hardware1.00
Natural language0.99
Vision0.69
Machine learning0.67
Knowledge representation0.01
Evolutionary computation0.00
Planning0.00

Ownership

MICROSOFT CORPORATION

assignment · 245650246

Assignors

KLEIN, CHRISTIAN, VASSIGH, ALI M., FLAKS, JASON S., LARCO, VANESSA, SOEMO, THOMAS M.

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC