ENCODING AND ADAPTIVE, SCALABLE ACCESSING OF DISTRIBUTED MODELS

Patent №

US 10,885,285

Granted

2021-01-05

Filed 2018

Owner

GOOGLE LLC

Lab

Google DeepMind

AI components

ml · nlp · vision · speech · kr · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16116833

Systems, methods, and apparatus for accessing distributed models in automated machine processing, including using large language models in machine translation, speech recognition and other applications.

Machine learning Natural language Vision Speech Knowledge representation AI hardwareG06F 40/58G06F 40/44G06F 40/47G06F 40/49

Google Patents

AI classification

Natural language1.00

Speech1.00

Machine learning1.00

Vision1.00

AI hardware0.98

Knowledge representation0.83

Planning0.16

Evolutionary computation0.03

Ownership

GOOGLE LLC

assignment · 467920863

Assignors

OCH, FRANZ JOSEF, DEAN, JEFFREY ADGATE, BRANTS, THORSTEN, FRANZ, ALEXANDER MARK, PONTE, JAY M., XU, PENG, TEH, SHA-MAYN, CHIN, JEFFREY, THAYER, IGNACIO E., CARVER, ANTON, ROSART, DANIEL, HAWKINS, JOHN S., +1 more

On an employer assignment, the assignors are typically the inventors.

From the same owner

ADAPTIVE RANKING OF NAVIGATION SUGGESTIONSUS 12,694,045 · 2026 Multi-Image SearchUS 12,694,053 · 2026 GENERATING MULTI-MODAL RESPONSE(S) THROUGH UTILIZATION OF LARGE LANGUAGE MODEL(S)US 12,694,231 · 2026 MULTI-STAGE COMPUTATIONALLY EFFICIENT NEURAL NETWORK INFERENCEUS 12,694,268 · 2026 HIGH-RESOLUTION MULTIVIEW-CONSISTENT RENDERING AND ALPHA MATTING FROM SPARSE VIEWSUS 12,694,480 · 2026 Nonlinear Peri-Codec Optimization For Image And Video CodingUS 12,694,572 · 2026 OBJECT OUTLINE GENERATION FROM OVERHEAD IMAGERY USING ACTION SEQUENCE PREDICTIONUS 12,694,670 · 2026 CONTEXT-BASED SPEAKER COUNTER FOR A SPEAKER DIARIZATION SYSTEMUS 12,694,708 · 2026

Cites (40)

Providing a reliable distributed queuing serviceUS 8,370,395 · 2013 MACHINE TRANSLATION FEEDBACKUS 7,983,897 · 2011 SESSION INDEPENDENT BACKEND DATA CACHE SYSTEMUS 7,809,882 · 2010 SEMANTIC PROCESSING ENGINEUS 7,546,234 · 2009 OBJECT-ORIENTED METHOD AND SYSTEM OF REMOTE DIAGNOSTIC, CONTROL AND INFORMATION COLLECTION USING MULTIPLE FORMATS AND MULTIPLE PROTOCOLSUS 7,533,333 · 2009 LEARNING TRANSLATION RELATIONSHIPS AMONG WORDSUS 7,366,654 · 2008 LANGUAGE INPUT SYSTEM FOR MOBILE DEVICESUS 7,277,732 · 2007 NORMALIZING AND CLASSIFYING LOCALE-SPECIFIC INFORMATIONUS 7,225,199 · 2007 METHOD, SYSTEM AND PROGRAM FOR ASSOCIATING A RESOURCE TO BE TRANSLATED WITH A DOMAIN DICTIONARYUS 7,089,493 · 2006 GUIDED NATURAL LANGUAGE INTERFACE SYSTEM AND METHODUS 7,027,975 · 2006 COMMUNICATION PROCESSING SYSTEMUS 6,985,850 · 2006 USER SUPPORT APPARATUS AND SYSTEM USING AGENTSUS 6,922,670 · 2005 LANGUAGE-DRIVEN INTERFACE FOR AN AUTOMATED TESTING FRAMEWORKUS 6,907,546 · 2005 SYSTEM AND INTERATIVE METHOD FOR LEXICON, SEGMENTATION AND LANGUAGE MODEL JOINT OPTIMIZATIONUS 6,904,402 · 2005 DICTIONARY MANAGEMENT METHOD AND APPARATUSUS 6,789,057 · 2004 A TRANSCODING SYSTEM AND METHOD FOR IMPROVED ACCESS BY USERS WITH SPECIAL NEEDSUS 6,665,642 · 2003 TRANSLATION MANAGEMENT SYSTEMUS 6,526,426 · 2003 COMMUNICATION SYSTEM AND METHODUS 6,473,781 · 2002 Method for collaborative transformation and caching of web objects in a proxy networkUS 6,360,273 · 2002 NATIONAL LANGUAGE PROXY FILE SAVE AND INCREMENTAL CACHE TRANSLATION OPTION FOR WORLD WIDE WEB DOCUMENTSUS 6,347,316 · 2002 SYSTEM AND METHOD FOR NETWORK-BASED TELETRANSLATION FROM ONE NATURAL LANGUAGE TO ANOTHERUS 6,338,033 · 2002 ALIAS-FREE CONTENT-INDEXED OBJECT CACHEUS 6,292,880 · 2001 METHOD AND SYSTEM FOR IMPROVING MACHINE TRANSLATION ACCURACY USING TRANSLATION MEMORYUS 6,278,969 · 2001 A METHOD AND DEVICE FOR TRANSLATING A SOURCE TEXT INTO A TARGET USING MODELING AND DYNAMIC PROGRAMMINGUS 6,182,026 · 2001 AUTOMATIC LANGUAGE IDENTIFICATION USING BOTH N-GRAM AND WORD INFORMATIONUS 6,167,369 · 2000

and 15 more

Cited by (2)

Patent US 11,763,096US 11,763,096 Patent US 11,829,725US 11,829,725

Related research

Advancements in Distributed Systems for Large Language Model Training and ServingOpenAlex Distributed Training Frameworks for Large Language Models: Architectures, Challenges, and InnovationsOpenAlex APPLICATION OF LARGE LANGUAGE MODELS IN HIGHLY LOADED INFORMATION SYSTEMSOpenAlex Distributed LLMs and Multimodal Large Language Models: A Survey on Advances, Challenges, and Future DirectionsarXiv Distributed Hybrid Parallelism for Large Language Models: Comparative Study and System Design GuidearXiv

Full text

Google Patents