CONVERSATION ORCHESTRATION SYSTEM WITH NATURAL LANGUAGE PROCESSING AND RESPONSE HANDLING

A computing system is described that includes a natural language processing (NLP) node configured to receive an input data stream during a communication session with a customer; select a primary NLP engine for the communication session from a plurality of NLP engines based on accuracy scores, use case requirements, and/or performance constraints; and route the input data stream to the primary NLP engine. The NLP node may select one or more of the other NLP engines to operate as secondary NLP engines in training stages or as standby NLP engines during the communication session. The output from the primary NLP engine may be used to generate responses to customer queries within the input data stream. At a communication session boundary, the NLP node may select the most appropriate one of the NLP engines to operate as the primary NLP for a subsequent communication session.