MULTI-MODAL USER INTERFACE

Patent №

US 11,348,581

Granted

2022-05-31

Filed 2019

Owner

QUALCOMM INCORPORATED

Lab

AI components

5

nlp · vision · speech · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16685946

A device for multi-modal user input includes a processor configured to process first data received from a first input device. The first data indicates a first input from a user based on a first input mode. The first input corresponds to a command. The processor is configured to send a feedback message to an output device based on processing the first data. The feedback message instructs the user to provide, based on a second input mode that is different from the first input mode, a second input that identifies a command associated with the first input. The processor is configured to receive second data from a second input device, the second data indicating the second input, and to update a mapping to associate the first input to the command identified by the second input.

Natural languageVisionSpeechPlanningAI hardwareG10L 15/22G06F 3/017G06F 3/038G06F 3/0484G06F 3/04883G06F 3/167G06F 9/451G10L 15/20+5 more

AI classification

AI hardware1.00
Natural language1.00
Speech0.99
Planning0.96
Vision0.50
Machine learning0.48
Knowledge representation0.12
Evolutionary computation0.00

Ownership

QUALCOMM INCORPORATED

assignment · 518370566

Assignors

CHOUDHARY, RAVI, KIM, LAE-HOON, MOON, SUNKUK, GUO, YINYI, SAKI, FATEMEH, VISSER, ERIK

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC