SYSTEM AND METHOD FOR AUTOMATIC TEMPORAL ALIGNMENT BETWEEN MUSIC AUDIO SIGNAL AND LYRICS
Patent №
US 8,880,409
Granted
2014-11-04
Filed 2010
Owner
NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
Lab
—
AI components
3
ml · nlp · speech
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
12866159
A system provided herein may perform automatic temporal alignment between music audio signal and lyrics with higher accuracy than ever. A non-fricative section extracting 4 extracts non-fricative sound sections, where no fricative sounds exist, from the music audio signal. An alignment portion 17 includes a phone model 15 for singing voice capable of estimating phonemes corresponding to temporal-alignment features. The alignment portion 17 performs an alignment operation using as inputs temporal-alignment features obtained from a temporal-alignment feature extracting portion 11, information on vocal and non-vocal sections obtained from a vocal section estimating portion 9, and a phoneme network SN on conditions that no phonemes exist at least in non-vocal sections and that no fricative phonemes exist in non-fricative sound sections.
AI classification
Ownership
NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
assignment · 253920809
Assignors
FUJIHARA, HIROMASA, GOTO, MASATAKA
On an employer assignment, the assignors are typically the inventors.