SYSTEM AND METHOD FOR INTELLIGENT EVALUATION OF ARTIFICIAL INTELLIGENCE GENERATED TEXTS

A system and method for automatically evaluating computer generated content may include: calculating a plurality of metrics for an input text, where the plurality of metrics may include one or more perplexity scores describing a prediction of the input text by a large language model (LLM); determining, based on one or more of the calculated metrics, whether to accept or reject the input text; and performing an exchange of data between remotely connected computer devices based on the determining to accept or reject the text. In some embodiments, calculating of metrics and determining whether to accept or reject the input text may be performed without relying on any information received subsequent to the initial receiving of the input text. Some embodiments may perform automated computerized actions such as, e.g., deploy or discard an update to the LLM based on the determining whether to accept or reject the input text.