Entity Linking Based on Sentence Representation

Table 2

Fine-tuning BERT with different layers on KBP2017 dataset.

Layer	Accuracy (%)
Layer 1	77.21
Layer 2	79.00
Layer 3	77.98
Layer 4	81.53
Layer 5	82.08
Layer 6	79.12
Layer 7	76.18
Layer 8	80.93
Layer 9	81.59
Layer 10	82.67
Layer 11	84.17
Layer 12	77.65
First 4 layers	79.22
Last 4 layers	81.37
All layers	82.40

Best results are highlighted in bold.