SYSTEM AND METHOD FOR INTELLIGENT INITIATION OF A MAN-MACHINE DIALOGUE BASED ON MULTI-MODAL SENSORY INPUTS

Patent №

US 11,222,632

Granted

2022-01-11

Filed 2018

Owner

DMAI, INC.

Lab

AI components

6

ml · nlp · vision · speech · kr · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16233678

The present teaching relates to method, system, medium, and implementations for enabling communication with a user. Information representing surrounding of a user to be engaged in a new dialogue is received via the communication platform, wherein the information is acquired from a scene in which the user is present and captures characteristics of the user and the scene. Relevant features are extracted from the information. A state of the user is estimated based on the relevant features, and a dialogue context surrounding the scene is determined based on the relevant features. A topic for the new dialogue is determined based on the user, and a feedback is generated to initiate the new dialogue with the user based on the topic, the state of the user, and the dialogue context.

Machine learningNatural languageVisionSpeechKnowledge representationAI hardwareG10L 15/22G06F 40/30G06F 40/35G06V 20/10G06V 40/174G10L 15/24G10L 15/1815G10L 25/63+2 more

AI classification

Natural language1.00
Speech1.00
Machine learning0.99
Vision0.99
Knowledge representation0.98
AI hardware0.98
Planning0.04
Evolutionary computation0.03

Ownership

DMAI, INC.

assignment · 478600773

Assignors

LIU, CHANGSONG, FANG, RUI

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC