DUPLICATE IMAGE DETECTION BASED ON IMAGE CONTENT

The present technology can analyze a collection of images to generate a high-dimension first representation of each image in the collection of images, and then reduce the dimensionality of the high-dimension first representation of each image by identifying significant features from the high-dimension first representation to yield a reduced-dimension second representation for each image in the collection of images. The present technology can then compare the second representation of any image in the collection of images to the second representation of any other image in the collection of images, wherein images having identical second representation are duplicates.