GENERATION OF COMPUTER-BASED DISCOVERY AVATARS BASED ON TOKENIZATION OF PRIORITIZED SOURCE DATA

In embodiments of the present invention improved capabilities are described for developing, training, validating and deploying discovery avatars embodying mathematical models that may be used for document and data discovery and deployed within large data repositories. For example, an avatar may be constructed by machine learning processes, including by processing information related to what types of information analysts find useful in large data sets. Once constructed, an avatar may be deployed as an aid to human intuition in a wide range of analytical processes, such as related to national security, enterprise management (e.g., programs related to sales, marketing, product, promotions, placement, pricing and the like), dispute resolution (including litigation), forensic analysis, criminal, administrative, civil and private investigations, scientific investigations, research and development, and a wide range of others.