Patent №
US 8,380,488
Granted
2013-02-19
Filed 2007
Owner
GOOGLE INC.
AI components
2
nlp · kr
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
11737603
Methods, systems and apparatus, including computer program products, for identifying properties of an electronic document. In one aspect, a sequence of bytes representing text in a document is received. A plurality of byte-n-grams are identified from the bytes. For multiple encodings, a respective likelihood of each byte-n-gram occurring in each of the respective multiple encodings is identified. A respective encoding score for each of the multiple encodings is determined. A most likely encoding of the document is identified based on a highest encoding score among the encoding scores. In another aspect, a sequence of characters, having an encoding, are identified in a document. The sequence is segmented into features, each corresponding to two or more characters. A respective score for each of multiple languages is determined based on the features and a respective language model. A language of the document is identified based on the scores.
AI classification
Ownership
GOOGLE INC.
assignment · 201230826
Assignors
LIU, XIN, YANG, STEWART
On an employer assignment, the assignors are typically the inventors.