SYSTEM AND METHOD FOR PROCESSING LARGE AMOUNTS OF TRANSACTIONAL DATA

A system including a reference data server that stores a first set of data used in the plurality of processes, a load balancer that reconfigures the transactional data, a first stage processing system and a second stage processing system. The first stage processing system includes one or more first processing modules that execute at least one process of a first set of the plurality of processes on the reconfigured transactional data to generate first stage processed transactional data, each of the one or more first processing modules comprising an in-memory cache that stores a second set of data used in the at least one process, and a first stage data storage system that stores the first stage processed transactional data. The second stage processing system includes one or more second processing modules that execute at least one process of a second set of the plurality of processes on the first stage processed transactional data to generate second stage processed transactional data, each of the one or more second processing modules comprising an in-memory cache that dynamically stores a third set of data related to the at least one process, and a second stage data storage system that stores the second stage processed transactional data.