METHOD FOR DETECTING AND MITIGATING BIAS AND WEAKNESS IN ARTIFICIAL INTELLIGENCE TRAINING DATA AND MODELS

Patent №

US 11,256,989

Granted

2022-02-22

Filed 2021

Owner

UMNAI LIMITED

Lab

AI components

6

ml · nlp · vision · kr · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17370466

Bias may be detected globally and locally by harnessing the white-box nature of the eXplainable artificial intelligence, eXplainable Neural Nets, Interpretable Neural Nets, eXplainable Transducer Transformers, eXplainable Spiking Nets, eXplainable Memory Net and eXplainable Reinforcement Learning models. Methods for detecting bias, strength, and weakness of data sets and the resulting models may be described. A method may implement global bias detection which utilizes the coefficients of the model to identify, minimize, and/or correct potential bias within a desired error tolerance. Another method makes use of local feature importance extracted from the rule-based model coefficients to locally identify bias. A third method aggregates the feature importance over the results/explanations of multiple samples. Bias may also be detected in multi-dimensional data such as images. A backmap reverse indexing mechanism may be implemented. A number of mitigation methods are also presented to eliminate bias from the affected models.

Machine learningNatural languageVisionKnowledge representationPlanningAI hardwareG06N 3/082G06N 5/045G06F 17/18G06F 18/10G06F 18/213G06F 18/2178G06N 3/042G06N 3/045+12 more

AI classification

Natural language1.00
Machine learning1.00
Vision1.00
Knowledge representation1.00
Planning0.99
AI hardware0.91
Evolutionary computation0.01
Speech0.00

Ownership

UMNAI LIMITED

assignment · 567940219

Assignors

DALLI, ANGELO, PIRRONE, MAURO

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC