METHODS FOR PART-OF-SPEECH DETERMINATION AND USAGE

Methods for determination of parts of speech of words in a text or other non-verbal record are extended to include so-called Viterbi optimization based on stored statistical data relating to actual usage and to include noun-phrase parsing. The part-of-speech tagging method optimizes the product of individual word lexical probabilities and normalized three-word contextual probabilities. Normalization involves dividing by the contained two-word contextual probabilities. The method for noun phrase parsing involves optimizing the choices of, typically non-recursive, noun phrases by considering all possible beginnings and endings thereof, preferably based on the output of the part-of-speech tagging method.