Empirical Study of Homogeneous and Heterogeneous Ensemble Models for Software Development Effort Estimation

Table 9

Models’ performance using Desharnais dataset.

Model type	Model	MMRE	PRED (25)	EF
Individual	MLP	78.24	20.0	0.25
	SVR	73.83	33.3	0.45
	ANFIS	105.70	20.0	0.19
Homogeneous ensemble; (MLP)	HM-MLP-[Avg]	68.68	26.7	0.38
	HM-MLP-[WtAvg]	69.34	26.7	0.38
	HM-MLP-[MLP]	81.79	20.0	0.24
	HM-MLP-[SVR]	90.79	26.7	0.29
	HM-MLP-[FIS-FCM]	78.94	26.7	0.33
	HM-MLP-[FIS-SC]	62.21	26.7	0.42
	HM-MLP-[ANFIS-FCM]	62.84	26.7	0.42
	HM-MLP-[ANFIS-SC]	62.05	26.7	0.42
Homogeneous ensemble; (SVR)	HM-SVR-[Avg]	59.01	40.0	0.67
	HM-SVR-[WtAvg]	59.03	40.0	0.67
	HM-SVR-[MLP]	83.97	20.0	0.24
	HM-SVR-[SVR]	93.03	26.7	0.28
	HM-SVR-[FIS-FCM]	97.45	13.3	0.14
	HM-SVR-[FIS-SC]	82.08	20.0	0.24
	HM-SVR-[ANFIS-FCM]	81.97	20.0	0.24
	HM-SVR-[ANFIS-SC]	76.57	26.7	0.34
Homogeneous ensemble; (ANFIS)	HM-ANFIS-[Avg]	115.32	20.0	0.17
	HM-ANFIS-[WtAvg]	105.88	20.0	0.19
	HM-ANFIS-[MLP]	107.53	26.7	0.25
	HM-ANFIS-[SVR]	90.80	26.7	0.29
	HM-ANFIS-[FIS-FCM]	104.29	13.3	0.13
	HM-ANFIS-[FIS-SC]	92.21	6.7	0.07
	HM-ANFIS-[ANFIS-FCM]	4850.60	13.3	0.00
	HM-ANFIS-[ANFIS-SC]	91.54	13.3	0.14
Heterogeneous ensemble; (MLP, SVR, ANFIS)	HT-(MLP, SVR, ANFIS)-[Avg]	66.13	33.3	0.50
	HT-(MLP, SVR, ANFIS)-[WtAvg]	66.86	26.7	0.39
	HT-(MLP, SVR, ANFIS)-[MLP]	79.30	33.3	0.42
	HT-(MLP, SVR, ANFIS)-[SVR]	92.49	26.7	0.29
	HT-(MLP, SVR, ANFIS)-[FIS-FCM]	85.29	20.0	0.23
	HT-(MLP, SVR, ANFIS)-[FIS-SC]	63.60	20.0	0.31
	HT-(MLP, SVR, ANFIS)-[ANFIS-FCM]	76.14	40.0	0.52
	HT-(MLP, SVR, ANFIS)-[ANFIS-SC]	68.20	20.0	0.29