REDUCING DATA STORAGE, MEMORY, AND COMPUTATIONAL TIME NEEDED FOR AD-HOC DATA ANALYSIS

A compressed data structure is disclosed for storing collected data and delivering ad-hoc data analysis. The compressed data structure can reduce hardware requirements, such as data storage requirements, and decrease processing requirements during ad-hoc data analysis. Raw data can be pre-aggregated to a base level of aggregation (base cell level) that is determined by the unique combination of attributes available for aggregation. Rather than storing the raw data, the entire distribution is stored at the base cell level along with a selection of pre-computed statistics of the raw data. At the time of ad-hoc analysis, pre-computed results based on the raw data can be retrieved or computed from the pre-computed statistics, or analysis of higher-level data can be computed on-demand based on the pre-aggregated base level data.