BERT Masked Language Modeling for Co-reference Resolution

This paper explains the TALP-UPC participation for the Gendered Pronoun Resolution shared-task of the 1st ACL Workshop on Gender Bias for Natural Language Processing. We have implemented two models for mask language modeling using pre-trained BERT adjusted to work for a classification problem. The proposed solutions are based on the word probabilities of the original BERT model, but using common English names to replace the original test names.

Interpretability interpretability Computer Science Linguistics

View graph Open-access PDF Source

Paper

Full text

BERT Masked Language Modeling for Co-reference Resolution

Semantic Scholar · Computer Science · 2019

Abstract

This paper explains the TALP-UPC participation for the Gendered Pronoun Resolution shared-task of the 1st ACL Workshop on Gender Bias for Natural Language Processing. We have implemented two models for mask language modeling using pre-trained BERT adjusted to work for a classification problem. The proposed solutions are based on the word probabilities of the original BERT model, but using common English names to replace the original test names.

Source of record · Semantic Scholar

Similar papers

Transfer Learning from Pre-trained BERT for Pronoun ResolutionXingce Bao, Qianqian Qiao2019 · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · 17 citations In Library

UnMASKed: Quantifying Gender Biases in Masked Language Models through Linguistically Informed Job Market PromptsIñigo Parra2024 · Conference of the European Chapter of the Association for Computational Linguistics · 4 citations In Library

Fill the GAP: Exploiting BERT for Pronoun ResolutionKai-Chou Yang, Timothy Niven, Tzu-Hsuan Chou et al.2019 · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · 4 citations In Library

Resolving Gendered Ambiguous Pronouns with BERTKellie Webster, Marta Recasens, Vera Axelrod et al.2019 · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · 50 citations In Library

Detection, Classification, and Mitigation of Gender Bias in Large Language ModelsXiaoqing Cheng, Hongying Zan, Lulu Kong et al.2025 · arXiv (Cornell University) · 2 citations In Library

Resolving Gendered Ambiguous Pronouns with Gender-Fair Modeling Based on BERT Word EmbeddingsZhi Ling2023 · International Conference on Computing and Artificial Intelligence · 0 citations In Library

Gendered Pronoun Resolution using BERT and an extractive question answering formulationRakesh Chada2019 · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · 10 citations In Library

MSnet: A BERT-based Network for Gendered Pronoun ResolutionZili Wang2019 · Proceedings of the First Workshop on Gender Bias in Natural Language Processing · 4 citations In Library

Gender Bias in Masked Language Models for Multiple LanguagesMasahiro Kaneko, Aizhan Imankulova, Danushka Bollegala et al.2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies In Library

Underspecification in Language Modeling Tasks: A Causality-Informed Study of Gendered Pronoun ResolutionEmily McMilin2022 · arXiv (Cornell University) · 1 citation In Library

Source of record

Semantic Scholar

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal