Towards Linguistically Generalizable NLP Systems: A Workshop and Shared Task

This paper presents a summary of the first Workshop on Building\nLinguistically Generalizable Natural Language Processing Systems, and the\nassociated Build It Break It, The Language Edition shared task. The goal of\nthis workshop was to bring together researchers in NLP and linguistics with a\nshared task aimed at testing the generalizability of NLP systems beyond the\ndistributions of their training data. We describe the motivation, setup, and\nparticipation of the shared task, provide discussion of some highlighted\nresults, and discuss lessons learned.\n