Efficient Embedding Table Storage and Lookup

Patent №

US 11,599,518

Granted

2023-03-07

Filed 2021

Owner

GOOGLE LLC

AI components

3

ml · kr · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17147844

The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models. A computer-implemented method may include obtaining an embedding table comprising a plurality of embeddings respectively associated with a corresponding index of the embedding table, compressing each particular embedding of the embedding table individually allowing each respective embedding of the embedding table to be decompressed independent of any other embedding in the embedding table, packing the embedding table comprising individually compressed embeddings with a machine-learning model, receiving an input to use for locating an embedding in the embedding table, determining a lookup value based on the input to search indexes of the embedding table, locating the embedding based on searching the indexes of the embedding table for the determined lookup value, and decompressing the located embedding independent of any other embedding in the embedding table.

Machine learningKnowledge representationAI hardwareG06F 16/2282G06F 16/35G06F 16/215G06F 16/2255G06F 16/3347G06F 30/27G06F 40/30G06N 3/04+9 more

AI classification

Machine learning1.00
Knowledge representation0.86
AI hardware0.74
Natural language0.29
Speech0.01
Vision0.00
Evolutionary computation0.00
Planning0.00

Ownership

GOOGLE LLC

assignment · 555170876

Assignors

MENGHANI, GAURAV

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC