SYSTEMS AND METHODS FOR QUANTIZING NEURAL NETWORKS VIA PERIODIC REGULARIZATION FUNCTIONS
Patent №
US 11,468,313
Granted
2022-10-11
Filed 2018
Owner
FACEBOOK, INC.,
AI components
4
ml · vision · planning · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
16006095
The disclosed computer-implemented method may include (1) identifying an artificial neural network comprising a set of nodes interconnected via a set of connections, and (2) training the artificial neural network by, for each connection in the set of connections, determining a quantized weight value associated with the connection. Determining the quantized weight value associated with the connection may include (1) associating a loss function with the connection, the loss function including a periodic regularization function that describes a relationship between an input value and a weight value of the connection, (2) determining a minimum of the associated loss function with respect to the weight value in accordance with the periodic regularization function, and (3) generating the quantized weight value associated with the connection based on the determined minimum of the loss function. Various other methods, systems, and computer-readable media are also disclosed.
AI classification
Ownership
FACEBOOK, INC.,
assignment · 487870577
Assignors
NAUMOV, MAXIM, DIRIL, ABDULKADIR UTKU, PARK, JONG SOO, RAY, BENJAMIN, JABLONSKI, JEDRZEJ, TULOCH, ANDREW JOHN
On an employer assignment, the assignors are typically the inventors.