AUDIO-VISUAL PERCEPTION SYSTEM AND APPARATUS AND ROBOT SYSTEM

Patent №

US 11,157,738

Granted

2021-10-26

Filed 2018

Owner

CLOUDMINDS TECHNOLOGY, INC.

Lab

AI components

1

vision

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16206845

An audio-visual perception system includes an audio perception module and a visual perception module, respectively receiving sounds and images of a subject and converting them into audio and visual signals. At least one of the above two modules is a first perception module having more than one working mode. A processing and control module controls the first perception module to switch a working mode thereof based on the audio or visual signals received from one of the two above modules other than the first perception module. An audio-visual perception apparatus having the audio-visual perception system is also disclosed, which can be used as a robot control unit (RCU) mounted onto a robot, allowing a human-in-the-loop robot operator to visually and audibly monitor the subject in a surrounding of the robot. The RCU can switch between a RCU mode and a cell phone mode.

VisionB25J 11/0005G06V 20/10B25J 9/161B25J 13/003B25J 13/08G06F 3/16G06F 3/167G06V 20/20

AI classification

Vision0.85
AI hardware0.11
Speech0.04
Knowledge representation0.02
Natural language0.01
Machine learning0.00
Evolutionary computation0.00
Planning0.00

Ownership

CLOUDMINDS TECHNOLOGY, INC.

assignment · 573520616

Assignors

BOLLA, BETTINA

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC