METHOD OF PROCESSING DATA

Data is extracted from multiple diverse sources and copied into an initial staging area in order to be processed. A copy of the data is persisted in non-volatile storage. Quality functions perform checking on the copy and store a checked copy into a clean staging area. New data elements are created by enriching the checked copy. Joins, lookups, aggregations, and delta processing are used to process the data which is then formatted and filtered into a target filtering area making the data load-ready for target applications.