TURN-BASED REINFORCEMENT LEARNING FOR DIALOG MANAGEMENT

Patent №

US 10,424,302

Granted

2019-09-24

Filed 2017

Owner

GOOGLE LLC

AI components

5

ml · nlp · speech · evo · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

15782333

Techniques are described related to turn-based reinforcement learning for dialog management. In various implementations, dialog states and corresponding responsive actions generated during a multi-turn human-to-computer dialog session may be obtained. A plurality of turn-level training instances may be generated, each including: a given dialog state of the plurality of dialog states at an outset of a given turn of the human-to-computer dialog session; and a given responsive action that was selected based on the given dialog state. One or more of the turn-level training instances may further include a turn-level feedback value that reflects on the given responsive action selected during the given turn. A reward value may be generated based on an outcome of the human-to-computer dialog session. The dialog management policy model may be trained based on turn-level feedback values of the turn-level training instance(s) and the reward value.

Machine learningNatural languageSpeechEvolutionary computationAI hardwareG06F 40/237G06F 16/90332G10L 15/005G10L 15/16G10L 15/30G10L 17/22H04L 51/02G10L 15/22

AI classification

Machine learning1.00
AI hardware1.00
Natural language0.99
Speech0.98
Evolutionary computation0.95
Planning0.23
Knowledge representation0.14
Vision0.04

Ownership

GOOGLE LLC

assignment · 438520545

Assignors

SHAH, PARARTH, HECK, LARRY PAUL, HAKKANI-TUR, DILEK

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC