MORPHOLOGICAL ANALYSIS METHOD AND DEVICE AND JAPANESE LANGUAGE MORPHOLOGICAL ANALYSIS METHOD AND DEVICE
Patent №
US 6,098,035
Granted
2000-08-01
Filed 1998
Owner
OKI ELECTRIC INDUSTRY CO., LTD.
Lab
—
AI components
2
ml · nlp
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
09044137
There is provided a morphological analysis method and device whereby, even if unknown words are present, processing can be effected with high accuracy and at high speed and economy of resources can be achieved. Expanded characters e.sub.i are generated by adding to each character c.sub.i of input text, in addition to word division information d.sub.i, expansion information including required arbitrarily selectable information such as tag information, and all possible expanded character sequences are generated. Beforehand, by training, the partial chain probabilities (appearance probabilities) of N-gram (where, normally N=1 or 2 or 3) character sequences are stored in an expanded character table. The partial character sequences of the expanded character sequences are successively extracted from the beginning of the expanded character sequence and the respective partial chain probabilities are found by referring to the expanded character table, and the product of the thus-found partial chain probabilities is obtained. This product is found for all the expanded character sequences, and analysis results etc. consisting of a row of word sequences in order of character sequences corresponding to largest such products, as well as a row of tag sequences and/or arbitrarily selectable information is output as the morphological analysis result.
AI classification
Ownership
OKI ELECTRIC INDUSTRY CO., LTD.
assignment · 90570140
Assignors
YAMAMOTO, HIDEKI, KITAMURA, MIHOKO, SHIMOHATA, SAYORI, YAMAMOTO, MIKIO
On an employer assignment, the assignors are typically the inventors.