RAPID ADJUSTMENT EVALUATION FOR SLOW-SCORING MACHINE LEARNING MODELS

Patent №

US 11,640,556

Granted

2023-05-02

Filed 2020

Owner

MICROSOFT TECHNOLOGY LICENSING, LLC

AI components

6

ml · nlp · vision · kr · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16775112

Techniques performed by a data processing system for analyzing the impact of training data changes on a machine learning model herein include training a first instance of a machine learning model with a first set of training data; modifying the first set of training data to produce a second set of training data; training a second instance of the model with the second set of training data; comparing the first instance of the model to the second instance of the model to determine features that differ between the first instance and the second instance of the model; identifying a subset of historical data associated with the features that differ between the first instance and the second instance of the model; and scoring the subset of the historical data to produce a report identifying differences in the output of the first instance and the second instance of the machine learning model.

Machine learningNatural languageVisionKnowledge representationPlanningAI hardwareG06N 20/00G06F 18/2113G06F 18/217G06N 5/045G06N 20/20G06V 10/757G06F 3/048

AI classification

Machine learning1.00
AI hardware1.00
Vision0.99
Natural language0.99
Planning0.96
Knowledge representation0.74
Evolutionary computation0.00
Speech0.00

Ownership

MICROSOFT TECHNOLOGY LICENSING, LLC

assignment · 516480105

Assignors

VELAGAPUDI, NISHANT, ZHU, ZHENGWEN, AYYALASOMAYAJULA, VENKATASATYA PREMNATH, RAMASAMY, RAJKUMAR

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC