LEARNING BASED APPROACH FOR ALIGNING IMAGES ACQUIRED WITH DIFFERENT MODALITIES

Methods and systems for aligning images for a specimen acquired with different modalities are provided. One method includes acquiring information for a specimen that includes at least first and second images for the specimen. The first image is acquired with a first modality different than a second modality used to acquire the second image. The method also includes inputting the information into a learning based model. The learning based model is included in one or more components executed by one or more computer systems. The learning based model is configured for transforming one or more of the at least first and second images to thereby render the at least the first and second images into a common space. In addition, the method includes aligning the at least the first and second images using results of the transforming. The method may also include generating an alignment metric using a classifier.