COMPRESSION OF MACHINE LEARNED MODELS

Patent №

US 10,970,470

Granted

2021-04-06

Filed 2020

Owner

AMAZON TECHNOLOGIES, INC.

AI components

4

nlp · speech · kr · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16783836

Devices and techniques are generally described for compression of natural language processing models. A first index value to a first address of a weight table may be stored in a hash table. The first address may store a first weight associated with a first feature of a natural language processing model. A second index value to a second address of the weight table may be stored in the hash table. The second address may store a second weight associated with a second feature of the natural language processing model. A first code associated with the first feature and comprising a first number of bits may be generated. A second code may be generated associated with the second feature and comprising a second number of bits greater than the first number of bits based on a magnitude of the second weight being greater than a magnitude of the first weight.

Natural languageSpeechKnowledge representationAI hardwareG06F 40/157G06F 16/9014G06N 5/01G06N 7/01G06N 20/00G10L 15/26H03M 7/3071H03M 7/3088+4 more

AI classification

Natural language1.00
AI hardware1.00
Speech0.90
Knowledge representation0.79
Machine learning0.06
Vision0.03
Evolutionary computation0.01
Planning0.01

Ownership

AMAZON TECHNOLOGIES, INC.

assignment · 517440694

Assignors

STRIMEL, GRANT, GROVER, SACHIN

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC