Investigating Tree Family Machine Learning Techniques for a Predictive System to Unveil Software Defects

Table 22

Family of hypotheses ordered by the p value and adjusting α by Nemenyi and Holm’s procedures, considering an initial α = 0.05.

Sr. no.	Algo	Algo	z		Nm 0.05	Holm	Ri-Rj	Inference from CD
1	RF	RT	24.00437415	1.81E − 09	0.001	0.0011111	4.196	Significant
2	CS-Forest	RF	22.00210271	3.91E − 09	0.001	0.0011364	3.846	Significant
3	Forest-PA	RT	21.60164842	4.60E − 09	0.001	0.0011628	3.776	Significant
4	CS-Forest	Forest-PA	19.59937698	1.09E − 08	0.001	0.0011905	3.426	Significant
5	CDT	RT	19.08450719	1.37E − 08	0.001	0.0012195	3.336	Significant
6	HT	RT	18.11197535	2.17E − 08	0.001	0.00125	3.166	Significant
7	LMT	RT	17.6771964	2.69E − 08	0.001	0.0012821	3.09	Significant
8	RT	REP-T	17.1394435	3.53E − 08	0.001	0.0013158	2.996	Significant
9	CDT	CS-Forest	17.08223575	3.63E − 08	0.001	0.0013514	2.986	Significant
10	CS-Forest	HT	16.10970391	6.06E − 08	0.001	0.0013889	2.816	Significant
11	CS-Forest	LMT	15.67492497	7.69E − 08	0.001	0.0014286	2.74	Significant
12	DS	RT	15.42321084	8.86E − 08	0.001	0.0014706	2.696	Significant
13	CS-Forest	REP-T	15.13717207	1.04E − 07	0.001	0.0015152	2.646	Significant
14	CS-Forest	DS	13.42093941	2.95E − 07	0.001	0.0015625	2.346	Significant
15	J48	RF	12.70012169	4.74E − 07	0.001	0.0016129	2.22	Significant
16	J48	RT	11.30425246	1.28E − 06	0.001	0.0016667	1.976	Significant
17	Forest-PA	J48	10.29739596	2.80E − 06	0.001	0.0017241	1.8	Significant
18	CS-Forest	J48	9.301981021	6.51E − 06	0.001	0.0017857	1.626	Significant
19	DS	RF	8.581163303	1.26E − 05	0.001	0.0018519	1.5	Significant
20	CDT	J48	7.780254728	2.76E − 05	0.001	0.0019231	1.36	Significant
21	RF	REP-T	6.864930643	7.35E − 05	0.001	0.002	1.2	Significant
22	HT	J48	6.807722887	7.84E − 05	0.001	0.0020833	1.19	Significant
23	J48	LMT	6.372943947	1.29E − 04	0.001	0.0021739	1.114	Significant
24	LMT	RF	6.327177742	1.37E − 04	0.001	0.0022727	1.106	Significant
25	DS	Forest-PA	6.178437578	1.63E − 04	0.001	0.002381	1.08	Significant
26	HT	RF	5.892398802	2.31E − 04	0.001	0.0025	1.03	Significant
27	J48	REP-T	5.835191046	2.48E − 04	0.001	0.0026316	1.02	Significant
28	CDT	RF	4.919866961	8.25E − 04	0.001	0.0027778	0.86	Significant
29	Forest-PA	REP-T	4.462204918	1.57E − 03	0.001	0.0029412	0.78	Significant
30	DS	J48	4.118958386	2.60E − 03	0.001	0.003125	0.72	Significant
31	Forest-PA	LMT	3.924452017	3.49E − 03	0.001	0.0033333	0.686	Significant
32	CDT	DS	3.661296343	5.22E − 03	0.001	0.0035714	0.64	Significant
33	Forest-PA	HT	3.489673077	6.83E − 03	0.001	0.0038462	0.61	Significant
34	DS	HT	2.688764502	2.48E − 02	0.001	0.0041667	0.47	Insignificant
35	CDT	Forest-PA	2.517141236	3.29E − 02	0.001	0.0045455	0.44	Insignificant
36	Forest-PA	RF	2.402725725	3.97E − 02	0.001	0.005	0.42	Insignificant
37	DS	LMT	2.253985561	5.07E − 02	0.001	0.0055556	0.394	Insignificant
38	CS-Forest	RT	2.002271437	7.63E − 02	0.001	0.00625	0.35	Insignificant
39	CDT	REP-T	1.945063682	8.36E − 02	0.001	0.0071429	0.34	Insignificant
40	DS	REP-T	1.716232661	1.20E − 01	0.001	0.0083333	0.3	Insignificant
41	CDT	LMT	1.407310782	1.93E − 01	0.001	0.01	0.246	Insignificant
42	CDT	HT	0.972531841	3.56E − 01	0.001	0.0125	0.17	Insignificant
43	HT	REP-T	0.972531841	3.56E − 01	0.001	0.0166667	0.17	Insignificant
44	LMT	REP-T	0.5377529	6.04E − 01	0.001	0.025	0.094	Insignificant
45	HT	LMT	0.434778941	6.74E − 01	0.001	0.05	0.076	Insignificant