Trust in Intrusion Detection Systems: An Investigation of Performance Analysis for Machine Learning and Deep Learning Models

Table 11

The performance of machine learning for WSN dataset using selected features.

Model	Evaluation metric	Cross-validation performance					Testing performance
		Normal	Grayhole	Blackhole	Scheduling	Flooding	Normal	Grayhole	Blackhole	Scheduling	Flooding
DT	TN	99.95	99.95	99.9	97.72	99.91	99.96	99.96	99.91	97.41	99.91
	FP	0.05	0.05	0.1	2.28	0.09	0.04	0.04	0.09	2.59	0.09
	FN	1.32	5.18	2.32	0.22	6.87	1.19	6.64	2.55	0.21	7.17
	Accuracy	99.92	99.9	99.82	99.59	99.79	99.92	99.90	99.81	99.57	99.78
	Precision	98.29	94.16	97.65	99.77	94.76	98.37	94.96	97.75	99.74	94.77
	Recall	98.68	94.82	97.68	99.78	93.13	98.81	93.36	97.45	99.79	92.83
	F-score	98.48	94.48	97.66	99.77	93.93	98.59	94.15	97.60	99.76	93.79
KNN	TN	99.59	99.81	99.38	80.16	99.98	99.63	99.81	99.37	80.60	99.98
	FP	0.41	0.19	0.62	19.84	0.02	0.37	0.19	0.63	19.40	0.02
	FN	16.13	32.11	27.18	0.6	40.55	16.24	28.74	27.27	0.59	38.31
	Accuracy	99.17	99.53	98.34	97.62	99.26	99.21	99.55	98.33	97.67	99.30
	Precision	84.84	76.46	82.55	98.01	97.7	86.26	76.52	82.32	98.05	98.27
	Recall	83.87	67.89	72.82	99.4	59.45	83.76	71.26	72.73	99.41	61.69
	F-score	84.34	71.88	77.36	98.7	73.91	84.99	73.80	77.23	98.72	75.80
RF	TN	99.95	99.93	99.93	98.28	99.96	99.95	99.94	99.95	98.28	99.96
	FP	0.05	0.07	0.07	1.72	0.04	0.05	0.06	0.05	1.72	0.04
	FN	0.91	0.96	1.89	0.17	7.04	0.60	0.72	2.03	0.15	6.99
	Accuracy	99.93	99.92	99.86	99.69	99.84	99.93	99.94	99.87	99.71	99.84
	Precision	98.16	92.81	98.24	99.82	97.84	98.11	93.94	98.68	99.82	97.66
	Recall	99.09	99.04	98.11	99.83	92.96	99.40	99.28	97.97	99.85	93.01
	F-score	98.62	95.82	98.17	99.83	95.33	98.75	96.54	98.32	99.84	95.28
NB	TN	99.48	91.62	96.04	56.01	99.95	99.50	91.49	95.95	57.42	99.96
	FP	0.52	8.38	3.96	43.99	0.05	0.50	8.51	4.05	42.58	0.04
	FN	63.86	25.09	70.4	12.48	40.93	61.82	26.45	70.87	12.58	40.60
	Accuracy	97.78	91.47	93.45	84.61	99.23	97.85	91.33	93.34	84.65	99.24
	Precision	65.47	7.39	23.26	95.14	95.83	67.68	7.16	22.55	95.28	96.20
	Recall	36.14	74.91	29.6	87.52	59.07	38.18	73.55	29.13	87.42	59.40
	F-score	46.54	13.44	26.04	91.17	73.08	48.82	13.05	25.42	91.18	73.45