Language models and deep neural networks for Arabic named entity recognition

Abstract

Token type identification lies at the core of named entity recognition, allowing models to distinguish named entities from non-entity tokens and thereby better capture sentence meaning. This paper presents a deep learning approach for the Arabic named entity recognition task, leveraging deep neural networks and pretrained language models. The proposed model is a combination of the AraELECTRA language model with the bidirectional long short-term memory (BiLSTM) neural network. We utilize the WojoodNER dataset, which provides fine-grained annotations of Arabic text across 21 entity types. The results of this approach are encouraging, with an accuracy of 98.29% and an F1-score of 87%.