ANNOTATED SYNTHESIZED SPEECH DATA

Techniques for evaluating speech synthesis components are described. A system presents speech synthesis audio along with the underlying content (such as text) and allows a user to indicate where an error (such as a pause error) appears in the synthesized speech, along with a category and severity of the error. The system may perform operations to make corrections based on the user inputs. The system may also generate training data and/or a test set of similar annotated data, which may be used to train/retrain and/or evaluate speech synthesis model(s) in an automated fashion.