Arabic Syntactic Diacritics Restoration Using BERT Models

Table 4

CEER of one-step and two-step fine-tuning model.

Model	CEER (%)
AraBERT-v02 base and one step fine-tuning using ATB dataset	3.28
AraBERT-v02 base and two steps fine-tuning using Tashkeela and ATB datasets	2.94