SYSTEMS AND METHODS FOR DETECTING SENSITIVE INFORMATION USING PATTERN RECOGNITION

Methods and systems for identifying sensitive information are provided. The method includes tokenizing labeled data into first word sequences, the labeled data including sensitive information. The method includes associating the labeled sensitive information with tags. The method includes determining that the first word sequences and the tags satisfy conditions defined by feature functions. The method includes calculating a local maximum of a likelihood function to determine a weight. The method includes tokenizing unlabeled data into second word sequences, the unlabeled data including sensitive information. The method includes executing each feature function based on their weights, the second word sequences, and tag sequences. The method includes selecting tag sequences that maximize probabilities of the second word sequences based on the likelihood function. The method includes identifying sensitive information in the unlabeled data based on the selected tag sequences.