VulDistilBERT: A CPS Vulnerability Severity Prediction Method Based on Distillation Model

Table 3

SVM, logistic regression, multilayer perceptron, and gradient boosting algorithms for evaluation results of metric combinations.

SVM		Logistic regression		Multilayer perceptron		Gradient boosting
Metric combination	Accuracy	Metric combination	Accuracy	Metric combination	Accuracy	Metric combination	Accuracy
5	0.6539	5	0.6539	5	0.6539	5	0.6539
6	0.6687	6	0.6687	6	0.6687	6	0.6687
0, 6	0.6749	5, 6	0.6765	0, 6	0.6748	0, 6	0.6749
5, 6	0.6765	5, 7	0.6701	5, 6	0.6765	5, 6	0.6765
2, 3, 5	0.7785	2, 3, 6	0.7976	0, 3, 6	0.7352	2, 3, 5	0.7785
2, 3, 6	0.8238	2, 5, 7	0.7093	2, 3, 5	0.7774	2, 3, 6	0.8238
2, 3, 5, 6	0.8892	2, 3, 5, 7	0.87412	2, 3, 5, 7	0.8823	2, 3, 5, 6	0.8887
2, 3, 5, 7	0.8839	2, 3, 6, 7	0.8275	2, 3, 6, 7	0.8461	2, 3, 5, 7	0.8810
0, 2, 3, 5, 6	0.9274	1, 2, 3, 5, 7	0.8962	0, 2, 3, 5, 7	0.9123	0, 2, 3, 5, 6	0.9244
0, 2, 3, 5, 7	0.9218	2, 3, 5, 6, 7	0.8935	1, 2, 3, 5, 6	0.9069	1, 2, 3, 5, 6	0.9187
0, 1, 2, 3, 5, 6	0.9575	0, 2, 3, 5, 6, 7	0.9130	0, 1, 2, 3, 5, 7	0.9265	0, 1, 2, 3, 5, 6	0.9443
0, 2, 3, 5, 6, 7	0.9522	1, 2, 3, 5, 6, 7	0.9271	1, 2, 3, 5, 6, 7	0.9424	0, 2, 3, 5, 6, 7	0.9488
0, 1, 2, 3, 4, 5, 6	0.9691	0, 1, 2, 3, 5, 6, 7	0.9486	0, 1, 2, 3, 5, 6, 7	0.9616	0, 1, 2, 3, 5, 6, 7	0.9792
0, 1, 2, 3, 5, 6, 7	0.9845	1, 2, 3, 4, 5, 6, 7	0.9252	1, 2, 3, 4, 5, 6, 7	0.9470	0, 2, 3, 4, 5, 6, 7	0.9544