SYSTEM AND METHOD FOR IMPROVING MACHINE LEARNING MODELS BY DETECTING AND REMOVING INACCURATE TRAINING DATA

Patent №

US 11,636,389

Granted

2023-04-25

Filed 2020

Owner

MICROSOFT TECHNOLOGY LICENSING, LLC

AI components

5

ml · vision · kr · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16795353

Methods, systems and computer program products are described to improve machine learning (ML) model-based classification of data items by identifying and removing inaccurate training data. Inaccurate training samples may be identified, for example, based on excessive variance in vector space between a training sample and a mean of category training samples, and based on a variance between an assigned category and a predicted category for a training sample. Suspect or erroneous samples may be selectively removed based on, for example, vector space variance and/or prediction confidence level. As a result, ML model accuracy may be improved by training on a more accurate revised training set. ML model accuracy may (e.g., also) be improved, for example, by identifying and removing suspect categories with excessive (e.g., weighted) vector space variance. Suspect categories may be retained or revised. Users may (e.g., also) specify a prediction confidence level and/or coverage (e.g., to control accuracy).

AI classification

Machine learning1.00
Vision1.00
Knowledge representation0.99
Planning0.99
AI hardware0.85
Natural language0.26
Evolutionary computation0.17
Speech0.00

Ownership

MICROSOFT TECHNOLOGY LICENSING, LLC

assignment · 518840294

Assignors

ELISHA, OREN, LUTTWAK, AMI, YEHUDA, HILA, KAHANA, ADAR, BECHLER-SPEICHER, MAYA

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC