https://aclanthology.org/2021.wanlp-1.20/
AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding - ACL Anthology
Wissam Antoun, Fady Baly, Hazem Hajj. Proceedings of the Sixth Arabic Natural Language Processing Workshop. 2021.
pre trainingarabic languagetextdiscriminators