Letter Model and Character Bigram based Language Model for Handwriting Recognition

A handwriting recognition system is described that includes a language model with scoring to improve recognition accuracy, such as for words outside of a selected language model. The handwriting recognition system increases the accuracy of handwriting recognizers that perform segmentation of ink into atomic elements (segments) and then classify each ink segment separately. After segmentation, a shape classifier estimates the class (letter) probabilities for each segment of ink by producing a corresponding score. The system applies the language model scoring to the shape classification results and typically selects the class with the highest score as the recognition result. Because the language model is not too restrictive, it works well for recognizing any word, even those that would not be in a dictionary for the current language. Thus, the handwriting recognition system produces better recognition results and can often recognize words that dictionary-based language models would not recognize correctly.