SYSTEMS AND METHODS FOR INTELLIGENTLY CURATING MACHINE LEARNING TRAINING DATA AND IMPROVING MACHINE LEARNING MODEL PERFORMANCE
Patent №
US 10,303,978
Granted
2019-05-28
Filed 2018
Owner
CLINC, INC.
Lab
—
AI components
7
ml · nlp · speech · kr · planning · evo · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
16143773
Systems and methods of intelligent formation and acquisition of machine learning training data for implementing an artificially intelligent dialogue system includes constructing a corpora of machine learning test corpus that comprise a plurality of historical queries and commands sampled from production logs of a deployed dialogue system; configuring training data sourcing parameters to source a corpora of raw machine learning training data from remote sources of machine learning training data; calculating efficacy metrics of the corpora of raw machine learning training data, wherein calculating the efficacy metrics includes calculating one or more of a coverage metric value and a diversity metric value of the corpora of raw machine learning training data; using the corpora of raw machine learning training data to train the at least one machine learning classifier if the calculated coverage metric value of the corpora of machine learning training data satisfies a minimum coverage metric threshold.
AI classification
Ownership
CLINC, INC.
assignment · 477400361
Assignors
KANG, YIPING, ZHANG, YUNQI, KUMMERFELD, JONATHAN K., HILL, PARKER, HAUSWALD, JOHANN, LAURENZANO, MICHAEL A., TANG, LINGJIA, MARS, JASON
On an employer assignment, the assignors are typically the inventors.