SYSTEMS AND METHODS FOR DETECTING CHARACTER ENCODINGS OF TEXT STREAMS

A computer-implemented method for detecting character encodings of text streams may include 1) identifying a request to identify a character encoding of a text stream, 2) dividing the text stream to identify a plurality of n-grams within the text stream, 3) identifying a plurality of vectors within a vector space, each vector representing a potential character encoding by a plurality of expected n-grams within the potential character encoding, 4) generating, based on the plurality of n-grams within the text stream and on an inverse frequency of appearance of each of the plurality of n-grams within the plurality of vectors, a representative vector describing the text stream, and 5) identifying the character encoding of the text stream based on identifying a similarity between the representative vector and a neighboring vector within the plurality of vectors representing the character encoding. Various other methods, systems, and computer-readable media are also disclosed.