SYSTEMS AND METHODS FOR PREDICTIVE DOCUMENT CODING USING CONTINUOUS ACTIVE MACHINE LEARNING
Patent №
US 10,692,017
Granted
2020-06-23
Filed 2017
Owner
RINA SYSTEMS, LLC
Lab
—
AI components
6
ml · nlp · vision · kr · planning · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
15604261
Systems and methods for predictive document coding using continuous active machine learning are described herein. A method uses both a primary queue and a plurality of secondary queues, where each secondary queue is associated with a model for category of documents. The method also repeatedly classifies new batches selected from a large set of documents that have not been reviewed. The classification uses the plurality of models and updates the secondary queues from the best documents in the most recently classified batch. While the method transparently cycles through batches, the most relevant documents are provided to one or more human reviewers from secondary queues via a primary queue. The reviewer confirms relevance or non-relevance in each of the documents for each of the categories. Periodically all the models are retrained using the set of reviewed documents after a selectable number of documents have been reviewed since the most recent retraining.
AI classification
Ownership
RINA SYSTEMS, LLC
assignment · 424970090
Assignors
CARR, TERENCE M
On an employer assignment, the assignors are typically the inventors.