Convolutional Neural Network (CNN) has always been a hot topic in deep learning. With the increasing demand for network models in daily production, the optimization of convolution calculation process is very important. This paper starts with the process of back propagation in convolutional neural network, introduces the derivation of convolutional neural network back propagation and the conversion process of im2col, uses implicit to convert the calculation of convolution on the domestic acceleration platform, and optimizes the convolution back propagation operator through a variety of general matrix multiplication optimization strategies. The final performance reaches more than 70% of the performance of NVIDIA operator, which meets the expectation of the experiment under the performance bottleneck of the platform.
Paper
Full text
Optimization of convolutional backpropagation operators based on domestic accelerators
OpenAlex · Neural Networks and Applications · 2023
Abstract
Convolutional Neural Network (CNN) has always been a hot topic in deep learning. With the increasing demand for network models in daily production, the optimization of convolution calculation process is very important. This paper starts with the process of back propagation in convolutional neural network, introduces the derivation of convolutional neural network back propagation and the conversion process of im2col, uses implicit to convert the calculation of convolution on the domestic acceleration platform, and optimizes the convolution back propagation operator through a variety of general matrix multiplication optimization strategies. The final performance reaches more than 70% of the performance of NVIDIA operator, which meets the expectation of the experiment under the performance bottleneck of the platform.