AUGMENTED REALITY METHOD AND DEVICE FUSING IMAGE-BASED TARGET STATE DATA AND SOUND-BASED TARGET STATE DATA

Patent №

US 11,257,293

Granted

2022-02-22

Filed 2020

Owner

BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO., LTD.

+1 more

Lab

AI components

2

vision · kr

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16771120

The invention discloses an augmented reality method and device, and relates to the field of computer technology. A specific implementation of the method includes: acquiring video information of a target, and acquiring real image information and real sound information of the target from the same; using the real image information to determine at least one image-based target state data, and using the real sound information to determine at least one sound-based target state data; fusing the image-based and sound-based target state data of the same type to obtain a target portrait data; and acquiring virtual information corresponding to the target portrait data, and superimposing the virtual information on the video information. This implementation can identify the current state of the target based on the image information and sound information of the target, and fuse the two identification results to obtain an accurate target portrait. Based on the target portrait, virtual information display matching the user status can be displayed, thereby improving augmented reality and user experience.

VisionKnowledge representationA63F 13/655A63F 13/213A63F 13/53G06F 3/01G06F 18/23213G06T 7/70G06T 11/00G06T 19/006+1 more

AI classification

Vision1.00
Knowledge representation0.78
Machine learning0.33
Natural language0.01
AI hardware0.01
Planning0.00
Speech0.00
Evolutionary computation0.00

Ownership

BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO., LTD.

assignment · 528820720

BEIJING JINGDONG CENTURY TRADING CO., LTD.

assignment · 528820720

Assignors

ZHANG, WEIHUA, WU, JIANGXU, LI, FAN, PENG, GANGLIN, ZHANG, HONGGUANG, KONG, LEIFENG

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC