DYNAMICALLY CAPTURING DATA WAREHOUSE POPULATION ACTIVITIES FOR ANALYSIS, ARCHIVAL, AND MINING

A system comprised of trigger mechanisms, a staging area, and an archived warehouse metadata table is used to extract, store, and archive extract, transform, and load (ETL) tasks from operational metadata in a data-warehousing environment. Operational metadata is comprised of ETL information; ETL task execution statuses, run number, definitions, control flow, and execution schedules. Specified ETL information is monitored and captured so that it may be extracted from operational metadata and transformed every time a trigger mechanism activates an update of stored data. Administrator-specified ETL task information is then stored in staging table. At specified intervals a staging table is refreshed with changes in operational data for each of the administrator-specified monitored and captured ETL tasks. Overwritten data, or outdated ETL task information, is then moved and stored in an archived warehouse metadata table. In one embodiment, archives are queried to generate reports analyzing the status of ETL tasks.