Local versus Global Models for Just-In-Time Software Defect Prediction

Table 4

Local vs. global models in the 10 times 10-fold cross-validation scenario.

Indicator	Project	Global	Local
			k = 2	k = 3	k = 4	k = 5	k = 6	k = 7	k = 8	k = 9	k = 10
AUC	BUG	0.730	0.704	0.687	0.684	0.698	0.688	0.686	0.686	0.693	0.685
	COL	0.742	0.719	0.708	0.701	0.703	0.657	0.666	0.670	0.668	0.660
	JDT	0.725	0.719	0.677	0.670	0.675	0.697	0.671	0.674	0.671	0.654
	MOZ	0.769	0.540	0.741	0.715	0.703	0.730	0.730	0.725	0.731	0.722
	PLA	0.742	0.733	0.702	0.693	0.654	0.677	0.640	0.638	0.588	0.575
	POS	0.777	0.764	0.758	0.760	0.758	0.753	0.755	0.705	0.757	0.757
	W/D/L	—	0/0/6	0/0/6	0/0/6	0/0/6	0/0/6	0/0/6	0/0/6	0/0/6	0/0/6
F1	BUG	0.663	0.644	0.628	0.616	0.603	0.598	0.608	0.610	0.601	0.592
	COL	0.696	0.672	0.649	0.669	0.678	0.634	0.537	0.596	0.604	0.564
	JDT	0.723	0.706	0.764	0.757	0.734	0.695	0.615	0.643	0.732	0.722
	MOZ	0.825	0.374	0.853	0.758	0.785	0.741	0.718	0.737	0.731	0.721
	PLA	0.704	0.678	0.675	0.527	0.477	0.557	0.743	0.771	0.627	0.604
	POS	0.762	0.699	0.747	0.759	0.746	0.698	0.697	0.339	0.699	0.700
	W/D/L	—	0/0/6	2/0/4	1/1/4	0/1/5	0/0/6	0/1/5	1/0/5	0/1/5	0/1/5
ACC	BUG	0.421	0.452	0.471	0.458	0.424	0.451	0.450	0.463	0.446	0.462
	COL	0.553	0.458	0.375	0.253	0.443	0.068	0.195	0.459	0.403	0.421
	JDT	0.354	0.532	0.374	0.431	0.291	0.481	0.439	0.314	0.287	0.334
	MOZ	0.189	0.386	0.328	0.355	0.364	0.301	0.270	0.312	0.312	0.312
	PLA	0.368	0.472	0.509	0.542	0.497	0.509	0.456	0.442	0.456	0.495
	POS	0.336	0.490	0.397	0.379	0.457	0.442	0.406	0.341	0.400	0.383
	W/D/L	—	5/0/1	4/1/1	4/1/1	3/1/2	4/1/1	4/1/1	2/2/2	3/1/2	4/1/1
	BUG	0.742 055	0.747	0.744	0.726	0.738	0.749	0.750	0.760	0.750	0.766
	COL	0.726	0.661	0.624	0.401	0.731	0.295	0.421	0.644	0.628	0.681
	JDT	0.660	0.779	0.625	0.698	0.568	0.725	0.708	0.603	0.599	0.634
	MOZ	0.555	0.679	0.626	0.645	0.659	0.588	0.589	0.643	0.634	0.630
	PLA	0.664	0.723	0.727	0.784	0.746	0.758	0.718	0.673	0.716	0.747
	POS	0.673	0.729	0.680	0.651	0.709	0.739	0.683	0.596	0.669	0.644
	W/D/L	—	4/1/1	2/2/2	2/1/3	3/2/1	4/1/1	2/3/1	1/2/3	1/3/2	2/1/3