MULTIMODAL TRANSMISSION OF PACKETIZED DATA

Patent №

US 11,705,121

Granted

2023-07-18

Filed 2020

Owner

GOOGLE LLC

AI components

4

ml · nlp · speech · kr

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16936972

A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.

Machine learningNatural languageSpeechKnowledge representationG10L 15/22G06F 3/167G06F 40/279G10L 15/1822G10L 2015/088G10L 2015/223

AI classification

Natural language1.00
Speech1.00
Machine learning1.00
Knowledge representation1.00
Planning0.34
AI hardware0.06
Vision0.01
Evolutionary computation0.00

Ownership

GOOGLE LLC

assignment · 532950044

Assignors

BHAYA, GAURAV, STETS, ROBERT, PATIL, UMESH

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC