NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Training

We experiment with COVID-Twitter-BERT and RoBERTa models to identify\ninformative COVID-19 tweets. We further experiment with adversarial training to\nmake our models robust. The ensemble of COVID-Twitter-BERT and RoBERTa obtains\na F1-score of 0.9096 (on the positive class) on the test data of WNUT-2020 Task\n2 and ranks 1st on the leaderboard. The ensemble of the models trained using\nadversarial training also produces similar result.\n