METHOD FOR DETECTING AND MITIGATING BIAS AND WEAKNESS IN ARTIFICIAL INTELLIGENCE TRAINING DATA AND MODELS
Patent №
US 11,256,989
Granted
2022-02-22
Filed 2021
Owner
UMNAI LIMITED
Lab
—
AI components
6
ml · nlp · vision · kr · planning · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
17370466
Bias may be detected globally and locally by harnessing the white-box nature of the eXplainable artificial intelligence, eXplainable Neural Nets, Interpretable Neural Nets, eXplainable Transducer Transformers, eXplainable Spiking Nets, eXplainable Memory Net and eXplainable Reinforcement Learning models. Methods for detecting bias, strength, and weakness of data sets and the resulting models may be described. A method may implement global bias detection which utilizes the coefficients of the model to identify, minimize, and/or correct potential bias within a desired error tolerance. Another method makes use of local feature importance extracted from the rule-based model coefficients to locally identify bias. A third method aggregates the feature importance over the results/explanations of multiple samples. Bias may also be detected in multi-dimensional data such as images. A backmap reverse indexing mechanism may be implemented. A number of mitigation methods are also presented to eliminate bias from the affected models.
AI classification
Ownership
UMNAI LIMITED
assignment · 567940219
Assignors
DALLI, ANGELO, PIRRONE, MAURO
On an employer assignment, the assignors are typically the inventors.