MULTIPLE-PROCESSOR CORE OPTIMIZATION FOR PRODUCER-CONSUMER COMMUNICATION

A novel technique for improving throughput in a multi-core system (and in a virtual machine environment) in which data is processed according to a producer-consumer relationship by eliminating latencies caused by compulsory cache misses. A producer process is executed on one processor core and two or more instances of a consumer process are executed on different cores so that while the first instance of a consumer process is executed in a “consuming” mode to process a first subset of data elements produced by the producer process, a second instance of the consumer process pre-fetches, to its cache memory, a second subset of data items produced by the producer process. As a result, the second subset of data items is already cached at the core where the second instance is running even before the consumer process starts processing the second subset of data items.