AUGMENTED REALITY METHOD AND DEVICE FUSING IMAGE-BASED TARGET STATE DATA AND SOUND-BASED TARGET STATE DATA
Patent №
US 11,257,293
Granted
2022-02-22
Filed 2020
Owner
BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO., LTD.
+1 more
Lab
—
AI components
2
vision · kr
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
16771120
The invention discloses an augmented reality method and device, and relates to the field of computer technology. A specific implementation of the method includes: acquiring video information of a target, and acquiring real image information and real sound information of the target from the same; using the real image information to determine at least one image-based target state data, and using the real sound information to determine at least one sound-based target state data; fusing the image-based and sound-based target state data of the same type to obtain a target portrait data; and acquiring virtual information corresponding to the target portrait data, and superimposing the virtual information on the video information. This implementation can identify the current state of the target based on the image information and sound information of the target, and fuse the two identification results to obtain an accurate target portrait. Based on the target portrait, virtual information display matching the user status can be displayed, thereby improving augmented reality and user experience.
AI classification
Ownership
BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO., LTD.
assignment · 528820720
BEIJING JINGDONG CENTURY TRADING CO., LTD.
assignment · 528820720
Assignors
ZHANG, WEIHUA, WU, JIANGXU, LI, FAN, PENG, GANGLIN, ZHANG, HONGGUANG, KONG, LEIFENG
On an employer assignment, the assignors are typically the inventors.