ENSEMBLE OF CLUSTERED DUAL-STAGE ATTENTION-BASED RECURRENT NEURAL NETWORKS FOR MULTIVARIATE TIME SERIES PREDICTION

Patent №

US 11,699,065

Granted

2023-07-11

Filed 2020

Owner

NEC LABORATORIES AMERICA, INC.

Lab

AI components

6

ml · nlp · vision · speech · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16984359

A method for multivariate time series prediction is provided. Each time series from among a batch of multiple driving time series and a target time series is decomposed into a raw component, a shape component, and a trend component. For each decomposed component, select a driving time series relevant thereto from the batch and obtain hidden features of the selected driving time series, by applying the batch to an input attention-based encoder of an Ensemble of Clustered dual-stage attention-based Recurrent Neural Networks (EC-DARNNS). Automatically cluster the hidden features in a hidden space using a temporal attention-based decoder of the EC-DARNNS. Each Clustered dual-stage attention-based RNN in the Ensemble is dedicated and applied to a respective one of the decomposed components. Predict a respective value of one or more future time steps for the target series based on respective prediction outputs for each of the decomposed components by the EC-DARNNS.

Machine learningNatural languageVisionSpeechPlanningAI hardwareG06N 3/044G06F 18/214G06F 18/23G06F 18/24137G06N 3/0442G06N 3/045G06N 3/0455G06N 3/049+3 more

AI classification

Machine learning1.00
AI hardware1.00
Planning1.00
Vision1.00
Natural language1.00
Speech0.93
Knowledge representation0.00
Evolutionary computation0.00

Ownership

NEC LABORATORIES AMERICA, INC.

assignment · 533930057

Assignors

SONG, DONGJIN, CHEN, YUNCONG, CHEN, HAIFENG

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC