VISUAL-ACOUSTIC MONITORING SYSTEM FOR EVENT DETECTION, LOCALIZATION AND CLASSIFICATION

A monitoring system for locating and classifying an event in a monitoring area by a computation unit including a visual 3D capturing unit providing geometric 3D information and an acoustic capturing unit providing an acoustic information of the monitoring area. An event detector is configured with an acoustic channel and a visual channel to detect the event. The acoustic channel is configured to detect the event as a sound event in the acoustic information and to determine a localization of the sound. The visual channel is configured to detect the event as a visual event in the geometric 3D information and to derive a localization of the visual event. The event detector provides detected events with a region of interest for detected event, which is analyzed in order to assign the detected event a class within a plurality of event classes.