OPTIMIZED DATA COLLECTION OF RELEVANT MEDICAL IMAGES

Some embodiments of the present invention select image data that are valuable for developing and/or training a deep learning based algorithm. A semi-automated system identifies cases that are the most valuable (most impactful, useful, and/or most effective) for developing and/or training the deep learning algorithm. The semi-automated system monitors a degree of uncertainty in the results produced by an image processing algorithm. Cases where the degree of uncertainty is high, and consequently a confidence score is low, are made ready for analysis, classification, and/or annotation by human review. Once analyzed, classified and/or annotated by human review, the data is made available for use in developing and/or training the deep learning algorithm.