METHOD AND APPARATUS FOR IMPORT,TRANSFORM AND EXPORT OF DATA

A user specifies source data, optional transformations and defines a destination database, as well as its location. The user specification creates a package. A package consists of steps of associated tasks, with each step optionally having one or more precedence constraints. Execution of the package causes a data pump to import the user-specified data, conform the data in accordance with the user's definition of the destination database and export the data to that database. Processing occurs on a streaming, contiguous basis. As each row is pulled from source database into data pump, the user-defined transform is optionally applied and data lineage information is bound to the data.