HIERARCHICAL AND INTERPRETABLE SKILL ACQUISITION IN MULTI-TASK REINFORCEMENT LEARNING

Patent №

US 11,562,287

Granted

2023-01-24

Filed 2018

Owner

SALESFORCE.COM, INC.

Lab

AI components

6

ml · nlp · vision · kr · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

15885727

The disclosed technology reveals a hierarchical policy network, for use by a software agent, to accomplish an objective that requires execution of multiple tasks. A terminal policy learned by training the agent on a terminal task set, serves as a base task set of the intermediate task set. An intermediate policy learned by training the agent on an intermediate task set serves as a base policy of the top policy. A top policy learned by training the agent on a top task set serves as a base task set of the top task set. The agent is configurable to accomplish the objective by traversal of the hierarchical policy network. A current task in a current task set is executed by executing a previously-learned task selected from a corresponding base task set governed by a corresponding base policy, or performing a primitive action selected from a library of primitive actions.

Machine learningNatural languageVisionKnowledge representationPlanningAI hardwareG06N 3/08G06N 20/00G06F 9/4881G06N 3/006G06N 3/044G06N 3/0442G06N 3/045G06N 3/0464+3 more

AI classification

Planning1.00
Knowledge representation1.00
Machine learning1.00
AI hardware1.00
Vision1.00
Natural language0.57
Speech0.12
Evolutionary computation0.00

Ownership

SALESFORCE.COM, INC.

assignment · 449320941

Assignors

XIONG, CAIMING, SHU, TIANMIN, SOCHER, RICHARD

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC