STREAMING CONTEXTUAL UNIDIRECTIONAL MODELS

Patent №

US 11,244,673

Granted

2022-02-08

Filed 2019

Owner

MICROSOFT TECHNOLOGY LICENSING, LLC

AI components

5

ml · nlp · speech · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16516849

Streaming machine learning unidirectional models is facilitated by the use of embedding vectors. Processing blocks in the models apply embedding vectors as input. The embedding vectors utilize context of future data (e.g., data that is temporally offset into the future within a data stream) to improve the accuracy of the outputs generated by the processing blocks. The embedding vectors cause a temporal shift between the outputs of the processing blocks and the inputs to which the outputs correspond. This temporal shift enables the processing blocks to apply the embedding vector inputs from processing blocks that are associated with future data.

Machine learningNatural languageSpeechPlanningAI hardwareG10L 15/142G06F 40/149G06N 3/044G06N 3/0442G06N 3/049G06N 3/08G06N 3/09G10L 15/16+1 more

AI classification

AI hardware1.00
Machine learning1.00
Natural language0.97
Planning0.94
Speech0.86
Vision0.27
Knowledge representation0.08
Evolutionary computation0.01

Ownership

MICROSOFT TECHNOLOGY LICENSING, LLC

assignment · 498050740

Assignors

LI, JINYU, AGARWAL, AMIT KUMAR, GONG, YIFAN, KESAVAMOORTHY, HARINI

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC