FOCUSED HYPERPARAMETER TUNING USING ATTRIBUTION

According to some embodiments, a method includes determining test predictions by performing an inference process using a checkpointed learning model and test vectors. The checkpointed learning model includes hyperparameters and weights. The method further includes determining an attribution map by performing one or more attribution processes using the test predictions and the test vectors. The method further includes determining a score for each particular hyperparameter by analyzing the attribution map using an association classifier. The method further includes determining, based on the analysis by the association classifier, whether each particular hyperparameter should be frozen or tuned again. The method further includes updating the hyperparameters and weights of the neural network when it is determined that at least one particular hyperparameter should be tuned again.