METHODS AND SYSTEMS FOR TRAINING HVAC CONTROL USING SIMULATED AND REAL EXPERIENCE DATA

Patent №

US 11,525,596

Granted

2022-12-13

Filed 2019

Owner

JOHNSON CONTROLS TECHNOLOGY COMPANY

Lab

AI components

3

ml · planning · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16725961

Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.

Machine learningPlanningAI hardwareF24F 11/64F24F 11/47G05B 13/027G05B 13/04

AI classification

Machine learning1.00
AI hardware1.00
Planning0.84
Vision0.27
Knowledge representation0.15
Speech0.02
Natural language0.01
Evolutionary computation0.00

Ownership

JOHNSON CONTROLS TECHNOLOGY COMPANY

assignment · 517410677

Assignors

LEE, YOUNG M., JIANG, ZHANHONG, RAMAMURTI, VISWANATH, MURUGESAN, SUGUMAR, DREES, KIRK H., RISBECK, MICHAEL JAMES

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC