Automated Anatomic And Regional Location Of Disease Features In Colonoscopy Videos

A system for automatically analyzing a video recording of a colonoscopy includes a processor and memory storing instructions, which when executed by the processor, cause the processor to receive the video recording of the colonoscopy performed on the colon and detect informative frames in the video recording. A frame is informative if the clarity of the frame is above a threshold or if the frame includes clinically relevant information about the colon. The instructions cause the processor to generate scores indicating severity levels of a disease for a plurality of the informative frames, estimate locations of the plurality of the informative frames in the colon, and generate an output indicating a distribution of the scores over one or more segments of the colon by combining the scores generated for the plurality of the informative frames and the estimated locations of the plurality of the informative frames in the colon.