Learning World Graphs to Accelerate Hierarchical Reinforcement Learning

Patent №

US 11,562,251

Granted

2023-01-24

Filed 2019

Owner

SALESFORCE.COM, INC.

Lab

AI components

6

ml · nlp · vision · kr · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16533575

Systems and methods are provided for learning world graphs to accelerate hierarchical reinforcement learning (HRL) for the training of a machine learning system. The systems and methods employ or implement a two-stage framework or approach that includes (1) unsupervised world graph discovery, and (2) accelerated hierarchical reinforcement learning by integrating the graph.

Machine learningNatural languageVisionKnowledge representationPlanningAI hardwareG06N 3/006G06N 3/088G05D 1/0221G06N 3/044G06N 3/0442G06N 3/045G06N 3/0455G06N 3/047+6 more

AI classification

Machine learning1.00
Vision1.00
AI hardware1.00
Knowledge representation1.00
Natural language0.99
Planning0.89
Speech0.01
Evolutionary computation0.00

Ownership

SALESFORCE.COM, INC.

assignment · 513720714

Assignors

SHANG, WENLING, TROTT, ALEXANDER RICHARD, ZHENG, STEPHAN

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC