Research Article

[Retracted] Analyzing the Effect of Masking Length Distribution of MLM: An Evaluation Framework and Case Study on Chinese MRC Datasets

Table 11

The evaluation results of pretrained models and human performance on cloze datasets.

ModelsShort cloze datasetLong cloze dataset
QACPACQACPAC

Human performance97.4592.8795.2490.71
PLM with short cloze MLM64.6317.1065.8217.60
PLM with long cloze MLM63.2815.2067.0218.60