MULTI-STEP LINEAR INTERPOLATION OF LANGUAGE MODELS

Patent №

US 11,610,581

Granted

2023-03-21

Filed 2021

Owner

INTERNATIONAL BUSINESS MACHINES CORPORATION

AI components

5

ml · nlp · vision · speech · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17168982

A computer-implemented method is provided for generating a language model for an application. The method includes estimating interpolation weights of each of a plurality of language models according to an Expectation Maximization (EM) algorithm based on a first metric. The method further includes classifying the plurality of language models into two or more sets based on characteristics of the two or more sets. The method also includes estimating a hyper interpolation weight for the two or more sets based on a second metric specific to the application. The method additionally includes interpolating the plurality of language models using the interpolation weights and the hyper interpolation weight to generate a final language model.

Machine learningNatural languageVisionSpeechAI hardwareG10L 15/183G10L 15/187G06F 18/2321G06F 18/24G10L 15/063G10L 15/16G10L 15/197G10L 15/26+2 more

AI classification

Natural language1.00
Machine learning1.00
Speech1.00
AI hardware1.00
Vision0.91
Knowledge representation0.02
Planning0.01
Evolutionary computation0.00

Ownership

INTERNATIONAL BUSINESS MACHINES CORPORATION

assignment · 551660799

Assignors

ITOH, NOBUYASU, SUZUKI, MASAYUKI, KURATA, GAKUTO

On an employer assignment, the assignors are typically the inventors.

From the same owner

© 2026 NYSGPT2525 LLC