Arabic Syntactic Diacritics Restoration Using BERT Models

Table 2

Characteristics of the tested Arabic BERT models.

Model	Dataset size	Model parameters (M)
AraBERT-v02 base [33]	77 GB/8.6 B	135
Arabic BERT [38]	95 GB/8.2 B	110
Multi-dialect Arabic BERT [39]	—	110
BERT multilingual base model [31]	—	110
ARBERT [40]	61 GB/6.2 B	163
MARBERT [40]	128 GB/15.6 B	163