SYSTEM AND METHOD FOR DYNAMIC DATA INGESTION

A method is provided for dynamic ingestion of data. The method includes detecting presence of data sets in an input queue, each data set belonging to a group. The method additionally includes fetching the data sets from each group utilizing a parallel computation engine including multiple partitioned processors, wherein each group is assigned to a partition of one of the multiple partitioned processors for processing. The method further includes processing the data sets for each group utilizing a group level process of the multiple partitioned processors to obtain resultant data sets and transmitting the resultant data sets for each group to a business logic processor pool in order to process the data sets in accordance with existing rules in order to generate a final data set.