SYSTEM AND METHOD FOR TRACKING OBJECTS BY FUSING RESULTS OF MULTIPLE SENSING MODALITIES

The present invention is embodied in a system and method for efficiently and efficiently performing automated vision tracking, such as tracking human head movement and facial movement. The system and method of the present invention fuses results of multiple sensing modalities to achieve robust digital vision tracking The system and method effectively fuses together the results of multiple vision processing modalities for performing tracking tasks in order to achieve robust vision tracking. The approach integrates reports from several distinct vision processing procedures in a probabilistically coherent manner by performing inferences about the location and/or motion of objects that considers both the individual reports about targets provided by visual processing modalities, as well as inferences about the context-sensitive accuracies of the reports. The context-sensitive accuracies are inferred by observing evidence with relevance to the reliabilities of the different methods.