SYSTEM AND METHOD FOR IDENTIFYING UNIQUE AND DUPLICATE MESSAGES

Patent №

US 8,458,183

Granted

2013-06-04

Filed 2012

Owner

—

Lab

—

AI components

Assignment

None on record

Dataset

AIPD

2023_r1 edition

Application

13361900

View graph

A system and method for identifying unique and duplicate messages is provided. Messages are maintained, and a header and message body are extracted from each of the messages. A hash code is calculated for each message over at least part of the header and the body of that message. The messages with matching hash codes are grouped. One message in each group with two or more messages is randomly selected as a unique message. The remaining messages in the group are marked as exact duplicate messages.

Knowledge representationG06F 16/285G06F 11/1453G06F 16/1748G06F 16/244G06F 16/245G06F 16/26G06F 16/93G06Q 10/107+8 more

Google Patents

AI classification

Knowledge representation0.79

AI hardware0.32

Vision0.02

Evolutionary computation0.00

Natural language0.00

Planning0.00

Machine learning0.00

Speech0.00

Cites (36)

SYSTEMS AND METHODS FOR THE DISCOVERY AND PRESENTATION OF ELECTRONIC MESSAGES THAT ARE RELATED TO AN ELECTRONIC MESSAGEUS 7,035,903 · 2006 SYSTEM AND METHOD FOR EVALUATING A STRUCTURED MESSAGE STORE FOR MESSAGE REDUNDANCYUS 6,820,081 · 2004 PROCESS AND SYSTEM FOR SPARSE VECTOR AND MATRIX REPERESENTATION OF DOCUMENT INDEXING AND RETRIEVALUS 6,751,628 · 2004 SYSTEM AND METHOD FOR IMPLEMENTING A KNOWLEDGE MANAGEMENT SYSTEMUS 6,711,585 · 2004 METHODS, APPARATUS AND COMPUTER PROGRAM PRODUCTS FOR INFORMATION RETRIEVAL AND DOCUMENT CLASSIFICATION UTILIZING A MULTIDIMENSIONAL SUBSPACEUS 6,701,305 · 2004 CONCEPT-BASED SEARCH AND RETRIEVAL SYSTEMUS 6,675,159 · 2004 DETECTING DUPLICATE AND NEAR-DUPLICATE FILESUS 6,658,423 · 2003 LIGHTWEIGHT DOCUMENT CLUSTERINGUS 6,654,739 · 2003 SYSTEM AND METHOD FOR CLUSTERING DATA OBJECTS IN A COLLECTIONUS 6,598,054 · 2003 CONCEPT DECOMPOSITION USING CLUSTERINGUS 6,560,597 · 2003 APPARATUS FOR PREVENTING AUTOMATIC GENERATION OF A CHAIN REACTION OF MESSAGES IF A PRIOR EXTRACTED MESSAGE IS SIMILAR TO CURRENT PROCESSED MESSAGEUS 6,549,957 · 2003 INVERSE INFERENCE ENGINE FOR HIGH PERFORMANCE WEB SEARCHUS 6,510,406 · 2003 METHOD & APPARATUS FOR IDENTIFYING AND DISCARDING JUNK ELECTRONIC MAILUS 6,453,327 · 2002 TAXONOMY GENERATION FOR DOCUMENT COLLECTIONSUS 6,446,061 · 2002 E-MAIL FILTER AND METHOD THEREOFUS 6,421,709 · 2002 METHOD AND SYSTEM FOR AUTOMATICALLY MERGING FILES INTO A SINGLE INSTANCE STOREUS 6,389,433 · 2002 METHOD FOR CLUSTERING CLOSELY RESEMBLING DATA OBJECTSUS 6,349,296 · 2002 ALIAS-FREE CONTENT-INDEXED OBJECT CACHEUS 6,292,880 · 2001 METHOD AND APPARATUS FOR IDENTIFYING THE EXISTENCE OF DIFFERENCES BETWEEN TWO FILESUS 6,263,348 · 2001 METHOD AND APPARATUS FOR DETECTING AND SUMMARIZING DOCUMENT SIMILARITY WITHIN LARGE DOCUMENT SETSUS 6,240,409 · 2001 METHOD FOR DETERMING THE RESEMINING THE RESEMBLANCE OF DOCUMENTSUS 6,230,155 · 2001 PROCESS AND SYSTEM FOR RETRIEVAL OF DOCUMENTS USING CONTEXT-RELEVANT SEMANTIC PROFILESUS 6,189,002 · 2001 REPRESENTATION AND RETRIEVAL OF IMAGES USING CONTEXT VECTORS DERIVED FROM IMAGE INFORMATION ELEMENTSUS 6,173,275 · 2001 RECOGNIZING TEXT IN A MULTICOLOR IMAGEUS 6,148,102 · 2000 TEXT CLASSIFICATION SYSTEM AND METHODUS 6,137,911 · 2000

and 11 more

Related research

A Novel Framework for Handling Duplicate Images using Hashing TechniquesOpenAlex Development of the combined method of identification of near duplicates in electronic scientific worksOpenAlex Detecting Duplicate Videos Via Perceptual HashingOpenAlex Unmasking Frame Duplication: Comprehensive Approach to Detection in Digital Video Using Machine Learning Algorithms and Signal Processing TechniquesOpenAlex Hybrid Feature-Hash Module for Image Duplicate DetectionOpenAlex

Full text

Google Patents