GESTURE BASED ANNOTATIONS

Patent №

US 10,241,990

Granted

2019-03-26

Filed 2015

Owner

MICROSOFT TECHNOLOGY LICENSING, LLC

AI components

5

nlp · vision · speech · kr · planning

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

14836546

In an embodiment a device to convert conversations from a meeting to text and annotate the text is disclosed. In an embodiment a device is disclosed, comprising: a microphone; a camera; a processor; and a storage comprising a set of instructions; wherein the set of instructions causes a processor to: receive from the microphone, an audio recording containing speech of a participant of a meeting; receive from the camera, a video of the participant; identify the participant; convert the speech of the participant to a digital text; develop a skeletal map of the participant; recognize a gesture of the participant from the skeletal maps; detect and identify a target of the gesture; based on the target and the gesture determine an annotation for the digital text corresponding to a point of time of the gesture.

Natural languageVisionSpeechKnowledge representationPlanningG06F 40/169G06F 3/011G06F 3/017G06F 3/16H04L 12/1831G10L 15/26H04N 7/147

AI classification

Vision1.00
Speech1.00
Natural language1.00
Knowledge representation1.00
Planning0.99
AI hardware0.13
Evolutionary computation0.01
Machine learning0.01

Ownership

MICROSOFT TECHNOLOGY LICENSING, LLC

assignment · 364290566

Assignors

RAINISTO, ROOPE

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC