DarNERcorp: An annotated named entity recognition dataset in the Moroccan dialect.

Autor: Moussa HN; School of Science and Engineering, Al Akhawayn University in Ifrane, P.O. Box 104, Hassan II Avenue, Ifrane 53000, Morocco., Mourhir A; School of Science and Engineering, Al Akhawayn University in Ifrane, P.O. Box 104, Hassan II Avenue, Ifrane 53000, Morocco.
Jazyk: angličtina
Zdroj: Data in brief [Data Brief] 2023 May 12; Vol. 48, pp. 109234. Date of Electronic Publication: 2023 May 12 (Print Publication: 2023).
DOI: 10.1016/j.dib.2023.109234
Abstrakt: DarNERcorp is a manually annotated named entity recognition (NER) dataset in the Moroccan dialect, also called Darija. The dataset consists of 65,905 tokens and their corresponding tags according to BIO scheme. 13.8% of the tokens are named entities spanning four categories: person, location, organization, and miscellaneous. The data were scraped from the Moroccan Dialect section of Wikipedia and processed and annotated using open-source libraries and tools. The data are useful for the Arabic natural language processing (NLP) community as they address the lack in dialectal Arabic annotated corpora. This dataset can be used to train and evaluate named entity recognition systems in dialectal and mixed Arabic.
Competing Interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
(© 2023 The Author(s).)
Databáze: MEDLINE