SYSTEM AND METHOD FOR AUTOMATIC TEMPORAL ALIGNMENT BETWEEN MUSIC AUDIO SIGNAL AND LYRICS

Patent №

US 8,880,409

Granted

2014-11-04

Filed 2010

Owner

NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY

Lab

AI components

3

ml · nlp · speech

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

12866159

A system provided herein may perform automatic temporal alignment between music audio signal and lyrics with higher accuracy than ever. A non-fricative section extracting 4 extracts non-fricative sound sections, where no fricative sounds exist, from the music audio signal. An alignment portion 17 includes a phone model 15 for singing voice capable of estimating phonemes corresponding to temporal-alignment features. The alignment portion 17 performs an alignment operation using as inputs temporal-alignment features obtained from a temporal-alignment feature extracting portion 11, information on vocal and non-vocal sections obtained from a vocal section estimating portion 9, and a phoneme network SN on conditions that no phonemes exist at least in non-vocal sections and that no fricative phonemes exist in non-fricative sound sections.

AI classification

Natural language1.00
Machine learning1.00
Speech1.00
Vision0.26
AI hardware0.00
Evolutionary computation0.00
Knowledge representation0.00
Planning0.00

Ownership

NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY

assignment · 253920809

Assignors

FUJIHARA, HIROMASA, GOTO, MASATAKA

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC