DEVICE AND METHOD FOR NATURAL LANGUAGE PROCESSING THROUGH STATISTICAL MODEL COMPARISON

A computer-implemented method comprising: receiving the first set of words and the second set of words, wherein each of the first and second sets of words; calculating a first likelihood-based measure representing how well a first model can be fit to the first and second sets of words, the first model comprising a shared parametric distribution representing both the first and second sets of words; calculating a second likelihood-based measure representing how well a second model can be fit to the first and second sets of words, the second model comprising a first parametric distribution representing the first set of words and a second parametric distribution representing the second set of words; calculating a similarity score based on a ratio of the first likelihood measure to the second likelihood measure, the similarity score being representative of the similarity between the first and second sets of words; and outputting the similarity score.