Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognition

In many scenarios, named entity recognition (NER) models severely suffer from\nunlabeled entity problem, where the entities of a sentence may not be fully\nannotated. Through empirical studies performed on synthetic datasets, we find\ntwo causes of performance degradation. One is the reduction of annotated\nentities and the other is treating unlabeled entities as negative instances.\nThe first cause has less impact than the second one and can be mitigated by\nadopting pretraining language models. The second cause seriously misguides a\nmodel in training and greatly affects its performances. Based on the above\nobservations, we propose a general approach, which can almost eliminate the\nmisguidance brought by unlabeled entities. The key idea is to use negative\nsampling that, to a large extent, avoids training NER models with unlabeled\nentities. Experiments on synthetic datasets and real-world datasets show that\nour model is robust to unlabeled entity problem and surpasses prior baselines.\nOn well-annotated datasets, our model is competitive with the state-of-the-art\nmethod.\n

Paper

Similar papers

© 2026 NYSGPT2525 LLC