DETECTION OF MACHINE LEARNING MODEL DEGRADATION

Patent №

US 11,625,602

Granted

2023-04-11

Filed 2019

Owner

SAP SE

Lab

AI components

5

ml · nlp · vision · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16567695

A method may include training, based on a first training dataset, a machine learning model. A degradation of the machine learning model may be detected based on one or more accuracy key performance indicators including a prediction power metric and a prediction confidence metric. The degradation of the machine learning model may also be detected based on a drift and skew in an input dataset and/or an output dataset of the machine learning model. Furthermore, the degradation of the machine learning model may be detected based on an explicit feedback and/or an implicit feedback on a performance of the machine learning model. In response to detecting the degradation of the machine learning model, the machine learning model may be retrained based on a second training dataset that includes at least one training sample not included in the first training dataset. Related systems and articles of manufacture are also provided.

AI classification

Machine learning1.00
Planning1.00
AI hardware0.99
Natural language0.92
Vision0.62
Knowledge representation0.13
Evolutionary computation0.01
Speech0.00

Ownership

SAP SE

assignment · 503440346

Assignors

SARFERAZ, SIAR

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC