Research Article

Named Entity Recognition for Public Interest Litigation Based on a Deep Contextualized Pretraining Approach

Table 4

Comparison of results between each of the pretrained models (NER category).

MethodsPRF1

BERT-FC [36]75.571.773.5
BERT-BiLSTM-CRF [36]94.094.094.0
BERT-WWM-FC77.872.675.1
BERT-WWM-BiLSTM-CRF95.295.295.2
BERT-WWM-EXT-FC75.375.975.6
BERT-WWM-EXT-BiLSTM-CRF (proposed method)96.096.096.0
RoBERTa-FC74.368.371.2
RoBERTa-BiLSTM-CRF95.294.895.0
RoBERTa-WWM-FC74.369.371.7
RoBERTa-WWM-BiLSTM-CRF95.495.095.2
RoBERTa-WWM-EXT-FC75.870.072.8
RoBERTa-WWM-EXT-BiLSTM-CRF95.594.795.1
ALBERT-FC73.864.068.6
ALBERT-BiLSTM-CRF90.090.090.0

The bold values mean the optimal values among all the methods.