Trust in Intrusion Detection Systems: An Investigation of Performance Analysis for Machine Learning and Deep Learning Models

Table 10

The performance of machine learning for WSN dataset using all features.

Model	Evaluation metric	Cross-validation performance					Testing performance
		Normal	Grayhole	Blackhole	Scheduling	Flooding	Normal	Grayhole	Blackhole	Scheduling	Flooding
DT	TN	99.97	99.96	99.92	97.74	99.89	99.96	99.98	99.9	98.23	99.89
	FP	0.03	0.04	0.08	2.26	0.11	0.04	0.02	0.1	1.77	0.11
	FN	0.94	4.73	1.8	0.21	7.1	1.18	3.11	1.44	0.23	6.07
	Accuracy	99.95	99.91	99.86	99.6	99.77	99.93	99.95	99.85	99.63	99.78
	Precision	98.93	95.24	98.12	99.77	94.11	98.56	97.32	97.6	99.82	93.74
	Recall	99.06	95.27	98.2	99.79	92.9	98.82	96.89	98.56	99.77	93.93
	F-score	98.99	95.24	98.16	99.78	93.5	98.69	97.1	98.08	99.79	93.83
KNN	TN	99.71	99.85	99.56	84.25	99.89	99.72	99.9	99.57	84.14	99.89
	FP	0.29	0.15	0.44	15.75	0.11	0.28	0.1	0.43	15.86	0.11
	FN	10.35	25.36	20.58	0.53	35.25	9.82	22.67	21.01	0.49	36.23
	Accuracy	99.44	99.63	98.78	98.06	99.27	99.46	99.72	98.75	98.09	99.26
	Precision	89.46	81.57	88.02	98.41	91.68	89.95	85.71	88.35	98.4	91.57
	Recall	89.65	74.64	79.42	99.47	64.75	90.18	77.33	78.99	99.51	63.77
	F-score	89.55	77.94	83.48	98.94	75.9	90.07	81.31	83.41	98.96	75.18
RF	TN	99.96	99.94	99.95	98.26	99.99	99.96	99.96	99.93	98.42	100
	FP	0.04	0.06	0.05	1.74	0.01	0.04	0.04	0.07	1.58	0
	FN	0.46	1.36	1.42	0.12	7.23	0.52	0.89	1.53	0.12	6.07
	Accuracy	99.95	99.93	99.89	99.73	99.86	99.94	99.95	99.87	99.74	99.89
	Precision	98.66	94	98.67	99.82	99.52	98.45	95.3	98.3	99.84	99.78
	Recall	99.54	98.64	98.58	99.88	92.77	99.48	99.11	98.47	99.88	93.93
	F-score	99.09	96.26	98.63	99.85	96.02	98.96	97.17	98.39	99.86	96.77
NB	TN	99.97	93.06	96.4	98.81	90.56	99.97	93.05	96.32	99.08	90.26
	FP	0.03	6.94	3.6	1.19	9.44	0.03	6.95	3.68	0.92	9.74
	FN	65.69	18.57	53.21	16.99	18.31	65.31	20.00	52.24	17.42	15.99
	Accuracy	98.21	92.96	94.47	84.47	90.4	98.20	92.95	94.40	84.10	90.15
	Precision	97.14	9.48	34.53	99.85	13.5	97.07	8.51	34.91	99.89	13.37
	Recall	34.31	81.43	46.79	83.01	81.69	34.69	80.00	47.76	82.58	84.01
	F-score	50.67	16.98	39.72	90.65	23.17	51.11	15.38	40.33	90.41	23.07