MATRIX MULTIPLICATION ACCELERATION OF SPARSE MATRICES USING COLUMN FOLDING AND SQUEEZING
Patent №
US 10,620,951
Granted
2020-04-14
Filed 2018
Owner
INTEL CORPORATION
Lab
—
AI components
1
hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
16016278
Disclosed embodiments relate to sparse matrix multiplication (SMM) acceleration using column folding and squeezing. In one example, a processor, in response to a SMM instruction having fields to specify locations of first, second, and output matrices, the second matrix being a sparse matrix, uses execution circuitry to pack the second matrix by replacing one or more zero-valued elements with non-zero elements yet to be processed, each of the replaced elements further including a field to identify its logical position within the second matrix, and, the execution circuitry further to, for each non-zero element at row M and column K of the specified first matrix, generate a product of the element and each corresponding non-zero element at row K, column N of the packed second matrix, and accumulate each generated product with a previous value of a corresponding element at row M and column N of the specified output matrix.
AI classification
Ownership
INTEL CORPORATION
assignment · 478670345
Assignors
AZIZI, OMID, BOUDOUKH, GUY, WERNER, TONY, YANG, ANDREW, ROTZIN, MICHAEL, KOREN, CHEN, NURVITADHI, ERIKO
On an employer assignment, the assignors are typically the inventors.