LARGE LANGUAGE MODEL PERFORMANCE EVALUATION AND MODIFICATION

At least one processor may receive conversation data comprising a user input and a response to the user input generated by a large language model (LLM). The at least one processor may detect a behavior gap between the conversation data and at least one test conversation data comprising human-to-human communication samples. Based on the behavior gap, the at least one processor may retrain the LLM and/or provide an alternative response workflow for responding to the user input.