Cognitive Model Tuning with Rich Deep Learning Knowledge

A mechanism is provided in a data processing system comprising a processor and a memory, the memory comprising instructions that are executed by the processor to configure the processor to implement a cognitive service for cognitive model tuning with rich deep learning knowledge. The mechanism performs a first model training operation and records training data set and hyperparameter information for the model in a database. The mechanism performs a model testing operation using a testing data set and records metric values that result from the model testing in the database. For a next model training operation for a given model, the mechanism performs an anomalies check for the given model. The mechanism performs a difference comparison on the training data set, hyperparameter information, and the metric values. The mechanism generates a recommendation of a training data set and hyperparameters for the next model training operation. The mechanism performs the next model training operation.