SYSTEM, METHOD, AND COMPUTER PROGRAM FOR EVALUATING THIRD PARTY ARTIFICIAL INTELLIGENCE MODELS

As described herein, a system, method, and computer program are provided for evaluating third party AI models. A request is received from an interested party to evaluate an AI model created by a third party, where the request includes a portion of private data of the interested party, and an expected output of the AI model when applied to the portion of private data of the interested party. The AI model created by the third party is received. The AI model is evaluated by: causing the AI model to process the portion of private data of the interested party, accessing an actual output of the AI model resulting from the processing, and comparing the actual output with the expected output to generate an evaluation of the AI model. The evaluation of the AI model is then reported to the interested party.