METHOD AND APPARATUS FOR TRAINING A NEURAL NETWORK USING MODALITY SIGNALS OF DIFFERENT DOMAINS

An apparatus and a method for the disclosure relates to an artificial intelligence (AI) system that simulates functions such as recognition and determination of the human brain by using a machine training algorithm such as deep learning and an application of the AI system are provided. A neural network training method includes obtaining target modality signals of a first domain aligned in a time order and auxiliary modality signals of a second domain that are not aligned in the time order, extracting characteristic information of the target modality signals using a first neural network model, estimating the time order of the auxiliary modality signals using a second neural network model, and training the first neural network model based on a result of the estimation and the characteristic information.