SBugLocater: Bug Localization Based on Deep Matching and Information Retrieval

Table 5

Performance comparison between three layers.

Project	Model	Accuracy@k (%)			MAP	MRR
		k = 1	k = 5	k = 10
Eclipse UI	Relevance layer	13.2	22.8	32.4	0.140	0.160
	Semantic layer	21.3	45.3	54.5	0.351	0.475
	IR layer	16.4	28.5	36.4	0.280	0.304
	Relevance layer + semantic layer	32.1	59.7	68.3	0.403	0.500
	SBugLocater	43.8	69.0	79.7	0.426	0.530
JDT	Relevance layer	15.3	26.2	32.5	0.173	0.203
	Semantic layer	32.5	57.3	65.1	0.352	0.430
	IR layer	23.6	41.4	50.2	0.290	0.384
	Relevance layer + semantic layer	40.6	62.5	74.3	0.428	0.516
	SBugLocater	45.3	70.6	82.4	0.503	0.597
SWT	Relevance layer	14.3	24.5	34.7	0.153	0.193
	Semantic layer	35.6	55.2	69.3	0.396	0.460
	IR layer	28.4	41.5	50.9	0.289	0.310
	Relevance layer + semantic layer	40.3	62.8	74.6	0.417	0.523
	SBugLocater	43.7	71.6	80.3	0.461	0.576
Tomcat	Relevance layer	18.3	32.5	47.1	0.250	0.280
	Semantic layer	39.5	59.7	67.0	0.465	0.524
	IR layer	34.0	52.6	64.0	0.376	0.316
	Relevance layer + semantic layer	48.5	66.5	73.8	0.509	0.546
	SBugLocater	52.0	74.3	83.1	0.535	0.602