MISSION DRIVEN VIRTUAL CHARACTER FOR USER INTERACTION

Patent №

US 11,615,598

Granted

2023-03-28

Filed 2021

Owner

MAGIC LEAP, INC.

Lab

AI components

4

nlp · vision · speech · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17501867

An augmented reality (AR) display device can display a virtual assistant character that interacts with the user of the AR device. The virtual assistant may be represented by a robot (or other) avatar that assists the user with contextual objects and suggestions depending on what virtual content the user is interacting with. Animated images may be displayed above the robot's head to display its intents to the user. For example, the robot can run up to a menu and suggest an action and show the animated images. The robot can materialize virtual objects that appear on its hands. The user can remove such an object from the robot's hands and place it in the environment. If the user does not interact with the object, the robot can dematerialize it. The robot can rotate its head to keep looking at the user and/or an object that the user has picked up.

Natural languageVisionSpeechAI hardwareG06T 13/00G06T 19/006G02B 27/0093G02B 27/0172G06F 3/011G06F 3/013G06F 3/04815G06T 13/40+2 more

AI classification

AI hardware1.00
Vision0.97
Natural language0.93
Speech0.79
Knowledge representation0.34
Machine learning0.05
Planning0.02
Evolutionary computation0.00

Ownership

MAGIC LEAP, INC.

assignment · 590410366

© 2026 NYSGPT2525 LLC