Method and System of Selecting Word Sequence for Text Written in Language Without Word Boundary Markers
Patent №
US 8,510,099
Granted
2013-08-13
Filed 2010
Owner
ALIBABA GROUP HOLDING LIMITED
Lab
—
AI components
2
nlp · speech
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
12746889
The present disclosure discloses a method and apparatus of selecting a word sequence for a text written in a language without word boundary in order to solve the problem of having excessively large computation load when selecting an optimal word sequence in existing technologies. The disclosed method includes: segmenting a segment of the text to obtain different word sequences; determining a common word boundary for the word sequences; and performing optimal word sequence selection for portions of the word sequences prior to the common word boundary. Because optimal word sequence selection is performed for portions of word sequences prior to a common word boundary, shorter independent units can be obtained, thus reducing computation load of word segmentation.
AI classification
Ownership
ALIBABA GROUP HOLDING LIMITED
assignment · 245030289
Assignors
DAI, NENG
On an employer assignment, the assignors are typically the inventors.