SYSTEMS AND METHODS FOR ORCHESTRATING MICROSERVICE CONTAINERS INTERCONNECTED VIA A SERVICE MESH IN A MULTI-CLOUD ENVIRONMENT BASED ON A REINFORCEMENT LEARNING POLICY

Patent №

US 11,635,995

Granted

2023-04-25

Filed 2019

Owner

CISCO TECHNOLOGY, INC.

Lab

AI components

5

ml · kr · planning · evo · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16513510

A multi-cloud service mesh orchestration platform can receive a request to deploy an application as a service mesh application. The platform can tag the application with governance information (e.g., TCO, SLA, provisioning, deployment, and operational criteria). The platform can partition the application into its constituent components, and tag each component with individual governance information. For first time steps, the platform can select and perform a first set of actions for deploying each component to obtain individual rewards, state transitions, and expected returns. The platform can determine a reinforcement learning policy for each component that maximizes a total reward for the application based on the individual rewards, state transitions, and expected returns of each first set of actions selected and performed for each component. For second time steps, the platform can select and perform a second set of actions for each component based on the reinforcement learning policy for the component.

Machine learningKnowledge representationPlanningEvolutionary computationAI hardwareG06F 9/5072G06F 9/3877G06N 20/00H04L 67/1031H04L 67/1036H04L 67/34G06F 9/45558G06N 3/006+1 more

AI classification

Machine learning1.00
Planning1.00
AI hardware1.00
Knowledge representation0.99
Evolutionary computation0.96
Vision0.02
Natural language0.01
Speech0.00

Ownership

CISCO TECHNOLOGY, INC.

assignment · 497690454

Assignors

BAHL, ROHIT, SHERRILL, PAUL CLYDE, WILLIAMS, STEPHEN JOSEPH

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC