MULTIMODAL ENTITY AND COREFERENCE RESOLUTION FOR ASSISTANT SYSTEMS

Patent №

US 11,443,120

Granted

2022-09-13

Filed 2020

Owner

FACEBOOK, INC.

AI components

5

nlp · vision · kr · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17006377

In one embodiment, a method includes accessing visual data from a client system associated with a user, wherein the visual data comprises images portraying one or more objects, receiving, from the client system, a user request, wherein the user request comprises a coreference to a target object, resolving the coreference to the target object from among the one or more objects, resolving the target object to a specific entity, and sending, to the client system, instructions for providing a response to the user request, wherein the response comprises attribute information about the specific entity.

Natural languageVisionKnowledge representationPlanningAI hardwareG06Q 10/40G06F 3/011G06F 3/013G06F 9/453G06F 9/485G06F 9/4862G06F 9/4881G06F 9/54+73 more

AI classification

Planning1.00
Natural language1.00
Knowledge representation1.00
Vision0.99
AI hardware0.98
Machine learning0.05
Speech0.01
Evolutionary computation0.00

Ownership

FACEBOOK, INC.

assignment · 542100451

Assignors

PODDAR, SHIVANI, MOON, SEUNGWHAN, CROOK, PAUL ANTHONY, SUBBA, RAJEN

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC