METHOD FOR FINDING LARGE NUMBERS OF KEYWORDS IN CONTINUOUS TEST STREAMS

Patent №

US 6,311,183

Granted

2001-10-30

Filed 1999

Owner

DIR. NAT. SECURITY AGENCY, GOVERNMENT OF THE UNITED STATES, AS REPRESENTED BY, THE

Lab

—

AI components

nlp

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

09353235

View graph

A method of full-text scanning for matches in a large dictionary of keywords is described, suitable for SDI (selective dissemination of information). The method is applicable to large dictionaries (hundreds of thousands of entries) and to arbitrary byte sequences for both patterns and sample streams. The approach employs Boyer-Moore-Horspool skipping, extended to pattern collections and digrams, followed by an n-gram hash test, which also identifies a subset of feasible keywords for conventional pattern matching at each location of a putative match.

Natural languageG06F 16/90344Y10S 707/99936

Google Patents

AI classification

Natural language1.00

AI hardware0.37

Planning0.36

Knowledge representation0.09

Vision0.03

Machine learning0.02

Evolutionary computation0.00

Speech0.00

Ownership

DIR. NAT. SECURITY AGENCY, GOVERNMENT OF THE UNITED STATES, AS REPRESENTED BY, THE

assignment · 101070487

Assignors

COHEN, JONATHAN D.

On an employer assignment, the assignors are typically the inventors.

Cited by (32)

AUTOMATED DETECTION OF MALWARE USING TRAINED NEURAL NETWORK-BASED FILE CLASSIFIERS AND MACHINE LEARNINGUS 11,711,388 · 2023 SERVER-SUPPORTED MALWARE DETECTION AND PROTECTIONUS 11,212,307 · 2021 FAST SIGNATURE SCANUS 11,062,115 · 2021 AUTOMATED DETECTION OF MALWARE USING TRAINED NEURAL NETWORK-BASED FILE CLASSIFIERS AND MACHINE LEARNINGUS 10,979,444 · 2021 FAST SIGNATURE SCANUS 10,949,641 · 2021 FAST SIGNATURE SCANUS 10,860,832 · 2020 AUTOMATED DETECTION OF MALWARE USING TRAINED NEURAL NETWORK-BASED FILE CLASSIFIERS AND MACHINE LEARNINGUS 10,616,252 · 2020 SERVER-SUPPORTED MALWARE DETECTION AND PROTECTIONUS 10,560,472 · 2020 GENERATION AND USE OF TRAINED FILE CLASSIFIERS FOR MALWARE DETECTIONUS 10,304,010 · 2019 SERVER-SUPPORTED MALWARE DETECTION AND PROTECTIONUS 10,305,923 · 2019 GENERATION AND USE OF TRAINED FILE CLASSIFIERS FOR MALWARE DETECTIONUS 10,068,187 · 2018 GENERATION AND USE OF TRAINED FILE CLASSIFIERS FOR MALWARE DETECTIONUS 10,062,038 · 2018 GENERATION AND USE OF TRAINED FILE CLASSIFIERS FOR MALWARE DETECTIONUS 9,864,956 · 2018 SYSTEMS AND METHODS OF UTF-8 PATTERN MATCHINGUS 8,819,045 · 2014 SEMANTIC OBJECT CHARACTERIZATION AND SEARCHUS 8,543,598 · 2013 SELF-INDEXER AND SELF INDEXING SYSTEMUS 8,392,433 · 2013 MULTIPLE STRING SEARCHING USING TERNARY CONTENT ADDRESSABLE MEMORYUS 7,969,758 · 2011 LANGUAGE NEUTRAL TEXT VERIFICATIONUS 7,949,670 · 2011 OPTIMIZING SEARCH TREES BY INCREASING FAILURE SIZE PARAMETERUS 7,917,486 · 2011 SWITCHING CIRCUIT IMPLEMENTING VARIABLE STRING MATCHINGUS 7,889,727 · 2011 OPTIMIZING SEARCH TREES BY INCREASING SUCCESS SIZE PARAMETERUS 7,860,849 · 2010 MULTIPLE STRING SEARCHING USING CONTENT ADDRESSABLE MEMORYUS 7,783,654 · 2010 ITERATIVE COMPARE OPERATIONS USING NEXT SUCCESS SIZE BITMAPUS 7,676,444 · 2010 METHOD AND APPARATUS FOR OPTIMIZING STRING SEARCH OPERATIONSUS 7,636,717 · 2009 MULTIPLE STRING SEARCHING USING CONTENT ADDRESSABLE MEMORYUS 7,634,500 · 2009

and 7 more

Related research

ELSKE: Efficient Large-Scale Keyphrase ExtractionarXiv Evaluating search key distribution impact on searching performance in large data streamsOpenAlex Modified method of searching keywords and keyterms in text dataOpenAlex Efficient Evaluation of Continuous Text Search QueriesSemantic Scholar Extra large vocabulary continuous speech recognition algorithm based on information retrievalSemantic Scholar

Full text

Google Patents