TRANSLITERATION BASED DATA AUGMENTATION FOR TRAINING MULTILINGUAL ASR ACOUSTIC MODELS IN LOW RESOURCE SETTINGS
Patent №
US 11,568,858
Granted
2023-01-31
Filed 2020
Owner
INTERNATIONAL BUSINESS MACHINES CORPORATION
Lab
AI components
7
ml · nlp · vision · speech · kr · planning · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
17073337
A computer-implemented method of building a multilingual acoustic model for automatic speech recognition in a low resource setting includes training a multilingual network on a set of training languages with an original transcribed training data to create a baseline multilingual acoustic model. Transliteration of transcribed training data is performed by processing through the multilingual network a plurality of multilingual data types from the set of languages, and outputting a pool of transliterated data. A filtering metric is applied to the pool of transliterated data output to select one or more portions of the transliterated data for retraining of the acoustic model. Data augmentation is performed by adding one or more selected portions of the output transliterated data back to the original transcribed training data to update training data. The training of a new multilingual acoustic model through the multilingual network is performed using the updated training data.
AI classification
Ownership
INTERNATIONAL BUSINESS MACHINES CORPORATION
assignment · 540860915
Assignors
THOMAS, SAMUEL, AUDHKHASI, KARTIK, KINGSBURY, BRIAN E. D.
On an employer assignment, the assignors are typically the inventors.