HIERARCHICAL AND INTERPRETABLE SKILL ACQUISITION IN MULTI-TASK REINFORCEMENT LEARNING
Patent №
US 11,562,287
Granted
2023-01-24
Filed 2018
Owner
SALESFORCE.COM, INC.
Lab
—
AI components
6
ml · nlp · vision · kr · planning · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
15885727
The disclosed technology reveals a hierarchical policy network, for use by a software agent, to accomplish an objective that requires execution of multiple tasks. A terminal policy learned by training the agent on a terminal task set, serves as a base task set of the intermediate task set. An intermediate policy learned by training the agent on an intermediate task set serves as a base policy of the top policy. A top policy learned by training the agent on a top task set serves as a base task set of the top task set. The agent is configurable to accomplish the objective by traversal of the hierarchical policy network. A current task in a current task set is executed by executing a previously-learned task selected from a corresponding base task set governed by a corresponding base policy, or performing a primitive action selected from a library of primitive actions.
AI classification
Ownership
SALESFORCE.COM, INC.
assignment · 449320941
Assignors
XIONG, CAIMING, SHU, TIANMIN, SOCHER, RICHARD
On an employer assignment, the assignors are typically the inventors.