METHOD, ELECTRONIC DEVICE AND COMPUTER READABLE MEDIUM FOR INFORMATION PROCESSING FOR ACCELERATING NEURAL NETWORK TRAINING
Patent №
US 11,640,528
Granted
2023-05-02
Filed 2019
Owner
BAIDU USA LLC
Lab
—
AI components
5
ml · vision · kr · planning · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
16660259
A method for information processing for accelerating neural network training. The method includes: acquiring a neural network corresponding to a deep learning task; and performing iterations of iterative training on the neural network based on a training data set. The training data set includes task data corresponding to the deep learning task. The iterative training includes: processing the task data in the training data set using a current neural network, and determining, based on a processing result of the neural network on the task data in a current iterative training, prediction loss of the current iterative training; determining a learning rate and a momentum in the current iterative training; and updating weight parameters of the current neural network by gradient descent based on a preset weight decay, and the learning rate, the momentum, and the prediction loss in the current iterative training. This method achieves efficient and low-cost deep learning-based neural network training.
AI classification
Ownership
BAIDU USA LLC
assignment · 510120788
Assignors
CHENG, ZHIYU, LI, BAOPU, BAO, YINGZE
On an employer assignment, the assignors are typically the inventors.