SBugLocater: Bug Localization Based on Deep Matching and Information Retrieval

Table 4

Performance comparison on four benchmark projects.

Project	Model	Accuracy@k (%)			MAP	MRR
		k = 1	k = 5	k = 10
Eclipse UI	LR + WE	38.9	34.3	71.0	0.385	0.450
	BugLocator	29.3	49.4	59.3	0.334	0.376
	DeepLocator	40.9	64.7	73.5	0.403	0.481
	DeepLoc	43.5	68.0	78.5	0.415	0.523
	SBugLocater	43.8	69.0	79.7	0.426	0.530
JDT	LR + WE	37.3	64.5	74.1	0.401	0.489
	BugLocator	19.0	40.2	50.6	0.295	0.368
	DeepLocator	38.9	63.2	73.5	0.378	0.462
	DeepLoc	43.4	65.5	78.0	0.445	0.534
	SBugLocater	45.3	70.6	82.4	0.503	0.597
SWT	LR + WE	34.2	57.1	71.6	0.385	0.437
	BugLocator	22.4	38.4	52.7	0.276	0.312
	DeepLocator	35.6	59.6	74.3	0.397	0.486
	DeepLoc	39.1	65.1	75.1	0.401	0.492
	SBugLocater	43.7	71.6	80.3	0.461	0.576
Tomcat	LR + WE	47.2	68.5	75.3	0.499	0.549
	BugLocator	36.7	61.4	70.5	0.420	0.473
	DeepLocator	50.3	71.0	79.3	0.515	0.587
	DeepLoc	51.9	72.1	79.8	0.526	0.594
	SBugLocater	52.0	74.3	83.1	0.535	0.602