L-ReLF: A Framework for Lexical Dataset Creation

This paper introduces the L-ReLF (Low-Resource Lexical Framework), a reproducible methodology for creating high-quality, structured lexical datasets for underserved languages. The lack of standardized terminology in low resource languages, exemplified by Moroccan Darija, poses a critical barrier to knowledge equity in platforms like Wikipedia, often forcing editors to rely on inconsistent, ad-hoc methods to create new words in their language. Our research details the technical pipeline developed to overcome these challenges. We systematically address the difficulties of working with lowresource data, including source identification, utilizing Optical Character Recognition (OCR) despite its bias towards Modern Standard Arabic, and rigorous post-processing to correct errors and standardize the data model. The resulting structured dataset is fully compatible with Wikidata Lexemes, serving as a vital technical resource. The L-ReLF methodology is designed for generalizability, offering other language communities a clear path to build foundational lexical data for downstream NLP applications, such as Machine Translation and morphological analysis.

Paper

Similar papers

© 2026 NYSGPT2525 LLC