AUTOMATIC IDENTIFICATION OF DIALOG TIMING PROBLEMS FOR AN INTERACTIVE SPEECH DIALOG APPLICATION USING SPEECH LOG DATA INDICATIVE OF CASES OF BARGE-IN AND TIMING PROBLEMS

A method of analyzing dialog between a user and an interactive application having dialog turns is provided. The method includes accessing information indicative of a plurality of dialog turns between the application and at least one user and identifying instances where the application determined a response was received before an associated prompt had completed. The accessed information includes information related to operation of the application with a first grammar to recognize the response. The method includes identifying whether the response was received in a particular limited time period from when the associated prompt began. If the response was received in the limited time period, the method determines whether the response included one or more terms from the associated prompt by performing recognition on the response using a second grammar having more information related to grammar of a language than the first grammar.