EVALUATING VARYING-SIZED ACTION SPACES USING REINFORCEMENT LEARNING

Patent №

US 11,243,532

Granted

2022-02-08

Filed 2018

Owner

APPLE INC.

Lab

AI components

4

ml · kr · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16143124

A set of actions corresponding to a particular state of the environment of a vehicle is identified. A respective encoding is generated for different actions of the set, using elements such as distinct colors to distinguish attributes such as target lane segments. Using the encodings as inputs to respective instances of a machine learning model, respective value metrics are estimated for each of the actions. One or more motion-control directives to implement a particular action selected using the value metrics are transmitted to motion-control subsystems of the vehicle.

Machine learningKnowledge representationPlanningAI hardwareB60W 60/0011G05D 1/0088G05D 1/0221G05D 1/0291G06N 3/0464G06N 3/08G06N 3/092G06N 3/098+10 more

AI classification

Machine learning1.00
Planning1.00
AI hardware1.00
Knowledge representation0.67
Vision0.10
Natural language0.04
Evolutionary computation0.00
Speech0.00

Ownership

APPLE INC.

assignment · 473090626

Assignors

LEVIHN, MARTIN, RAIKO, PEKKA TAPANI

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC