SYSTEMS AND METHODS FOR ORCHESTRATING MICROSERVICE CONTAINERS INTERCONNECTED VIA A SERVICE MESH IN A MULTI-CLOUD ENVIRONMENT BASED ON A REINFORCEMENT LEARNING POLICY
Patent №
US 11,635,995
Granted
2023-04-25
Filed 2019
Owner
CISCO TECHNOLOGY, INC.
Lab
—
AI components
5
ml · kr · planning · evo · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
16513510
A multi-cloud service mesh orchestration platform can receive a request to deploy an application as a service mesh application. The platform can tag the application with governance information (e.g., TCO, SLA, provisioning, deployment, and operational criteria). The platform can partition the application into its constituent components, and tag each component with individual governance information. For first time steps, the platform can select and perform a first set of actions for deploying each component to obtain individual rewards, state transitions, and expected returns. The platform can determine a reinforcement learning policy for each component that maximizes a total reward for the application based on the individual rewards, state transitions, and expected returns of each first set of actions selected and performed for each component. For second time steps, the platform can select and perform a second set of actions for each component based on the reinforcement learning policy for the component.
AI classification
Ownership
CISCO TECHNOLOGY, INC.
assignment · 497690454
Assignors
BAHL, ROHIT, SHERRILL, PAUL CLYDE, WILLIAMS, STEPHEN JOSEPH
On an employer assignment, the assignors are typically the inventors.