SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)

Understanding tables is an important and relevant task that involves\nunderstanding table structure as well as being able to compare and contrast\ninformation within cells. In this paper, we address this challenge by\npresenting a new dataset and tasks that addresses this goal in a shared task in\nSemEval 2020 Task 9: Fact Verification and Evidence Finding for Tabular Data in\nScientific Documents (SEM-TAB-FACTS). Our dataset contains 981\nmanually-generated tables and an auto-generated dataset of 1980 tables\nproviding over 180K statement and over 16M evidence annotations. SEM-TAB-FACTS\nfeatured two sub-tasks. In sub-task A, the goal was to determine if a statement\nis supported, refuted or unknown in relation to a table. In sub-task B, the\nfocus was on identifying the specific cells of a table that provide evidence\nfor the statement. 69 teams signed up to participate in the task with 19\nsuccessful submissions to subtask A and 12 successful submissions to subtask B.\nWe present our results and main findings from the competition.\n

cs.CL Advanced Text Analysis Techniques Biomedical Text Mining and Ontologies Data Quality and Management

Paper

Similar papers

SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)Nancy X. R. Wang, Diwakar Mahajan, Marina Danilevsky et al.2021 In Library

BreakingBERT@IITK at SemEval-2021 Task 9 : Statement Verification and Evidence Finding with TablesAditya Jindal, Ankur Gupta, J. Srivastava et al.2021 · International Workshop on Semantic Evaluation · 4 citations In Library

Volta at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables using TAPAS and Transfer LearningDevansh Gautam, Kshitij Gupta, Manish Shrivastava2021 · arXiv (Cornell University) · 7 citations In Library

Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with TablesXiaoyi Ruan, Meizhi Jin, Jian Ma et al.2021 In Library

Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with TablesXiaoyi Ruan, Meizhi Jin, Jian Ma et al.2021 · arXiv (Cornell University) In Library

Volta at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables using TAPAS and Transfer LearningDevansh Gautam, Kshitij Gupta, Manish Shrivastava2021 In Library

TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen et al.2020 · arXiv (Cornell University) · 700 citations In Library

AttesTable at SemEval-2021 Task 9: Extending Statement Verification with Tables for Unknown Class, and Semantic Evidence FindingHarshit Varma, Aadish Kumar Jain, Pratik Ratadiya et al.2021 In Library

TAPAS at SemEval-2021 Task 9: Reasoning over tables with intermediate pre-trainingThomas Müller, Julian Martin Eisenschlos, Syrine Krichene2021 In Library

BOUN at SemEval-2021 Task 9: Text Augmentation Techniques for Fact Verification in Tabular DataAbdullatif Köksal, Yusuf Yüksel, Bekir Yıldırım et al.2021 In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal