Processing pipeline in a base services pattern environment

A system and method, are provided for structuring batch activities for simplified reconfiguration. A series of processing steps is prepared for performing on input objects being streamed into a batch processing system. Each of the processing steps is encapsulated within at least one of a plurality of filters. The input objects are received and processed in the filters. Results are delivered from the filters incrementally during the processing of the input objects for reducing latency and enabling parallel processing. Connectors are utilized for connecting at least two of the plurality of filters each having a processing step for creating a process. One of the two filters is an input filter of the process and the other of the two filters is an output filter of the process. Connectors are also used for connecting input and output filters of different processes for forming a scalable system.