SYSTEMS AND METHODS FOR AUTOMATICALLY SCRUBBING SENSITIVE DATA

Methods and systems are presented for automatically scrubbing sensitive data from text data comprising a sequence of words based on a negative word index. The negative word index may be constructed by obtaining articles that are publicly available and extracting words and word sequences from the articles. Statistical information associated with the word and word sequences from the articles may also be determined and included in the negative word index. To scrub sensitive data from the text data, a first sub-sequence of words is identified from the text data. The first sub-sequence of words may be determined to include sensitive information or not based on statistical information associated with the first sub-sequence of words within the negative word index. If the first sub-sequence of words includes sensitive information, the first sub-sequence of words may be removed from the text data.