Library

Towards Ontology Construction with Language Models

We present a method for automatically constructing a concept hierarchy for a given domain by querying a large language model. We apply this method to various domains using OpenAI's GPT 3.5. Our experiments indicate that LLMs can be of considerable help for constructing concept hierarchies.

cs.AISemantic Web and OntologiesNatural Language Processing TechniquesAdvanced Database Systems and QueriesComputer ScienceLinguistics
View graphSource

Paper

References (29)

01Evaluating Language Models for Knowledge Base CompletionBlerta Veseli, Sneha Singhania, S. Razniewski et al.2023 · Extended Semantic Web Conference · 28 citations In Library
02Crawling The Internal Knowledge-Base of Language ModelsRoi Cohen, Mor Geva, Jonathan Berant et al.2023 · Findings · 109 citations In Library
03Prompting as Probing: Using Language Models for Knowledge Base ConstructionDimitrios Alivanistos, Selene B'aez Santamar'ia, Michael Cochez et al.2022 · LM-KBC@ISWC · 60 citations In Library
04PaLM: Scaling Language Modeling with PathwaysA. Chowdhery, Sharan Narang, Jacob Devlin et al.2022 · Journal of machine learning research · 8.2k citations In Library
05Contextual semantic embeddings for ontology subsumption predictionJiaoyan Chen, Yuan He, E. Jiménez-Ruiz et al.2022 · World wide web (Bussum) · 69 citations In Library
06Survey of Hallucination in Natural Language GenerationZiwei Ji, Nayeon Lee, Rita Frieske et al.2022 · ACM Computing Surveys · 5.3k citations In Library
07Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelShaden Smith, M. Patwary, Brandon Norick et al.2022 · arXiv.org · 861 citations In Library
08Scaling Language Models: Methods, Analysis & Insights from Training GopherJack W. Rae, Sebastian Borgeaud, Trevor Cai et al.2021 · arXiv.org · 1.6k citations In Library
09Surface Form Competition: Why the Highest Probability Answer Isn’t Always RightAri Holtzman, Peter West, Vered Schwartz et al.2021 · Conference on Empirical Methods in Natural Language Processing · 304 citations In Library
10Learning How to Ask: Querying LMs with Mixtures of Soft PromptsGuanghui Qin, J. Eisner2021 · North American Chapter of the Association for Computational Linguistics · 603 citations In Library
11BERTese: Learning to Speak to BERTAdi Haviv, Jonathan Berant, A. Globerson2021 · Conference of the European Chapter of the Association for Computational Linguistics · 139 citations In Library
12Calibrate Before Use: Improving Few-Shot Performance of Language ModelsTony Zhao, Eric Wallace, Shi Feng et al.2021 · International Conference on Machine Learning · 2.0k citations In Library

Scroll for more · 17 remaining

Similar papers

Specific Domain Ontology Construction Using Large Language ModelsVivian Magri Alcaldi Soares, Renata Wassermann2026 · 0 citations In Library
Potential of Large Language Models for Ontology Development in Construction DomainDilan Durmus, Jože M. Rožanec, Alessandro Carbonari et al.2024 In Library
OntoCons: A Method for Intelligent Construction of Domain Ontology Models for Large Language ModelsYi Li, Wenxin Lu, Xiuzhen Xiang2025 In Library
Enhancing Ontologies with Large Language Models: A Semi-Automated ApproachTran Van Anh Pham, Sebastian Huettemann, Roland M. Mueller2025 · Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences In Library
Methodological Exploration of Ontology Generation with a Dedicated Large Language ModelMaria Assunta Cappelli, Giovanna Di Marzo Serugendo2025 · Electronics In Library
Ontology engineering with Large Language ModelsPatricia Mateiu, Adrian Groza2023 · arXiv (Cornell University) · 56 citations In Library
Towards Concept-Aware Large Language ModelsChen Shani, Jilles Vreeken, Dafna Shahaf2023 In Library
Towards Concept-Aware Large Language ModelsChen Shani, Jilles Vreeken, Dafna Shahaf2023 · arXiv (Cornell University) · 9 citations In Library
Large Language Models and Foundational OntologiesPaweł Garbacz2024 · Frontiers in artificial intelligence and applications · 0 citations In Library
Creation of ontologies through LLMsEliot Bytyçi, Korab Rrmoku2025 · 2025 3rd International Conference on Foundation and Large Language Models (FLLM) · 0 citations In Library
© 2026 NYSGPT2525 LLC