Safety Prediction Using Vehicle Safety Evaluation Model Passing on Long-Span Bridge with Fully Connected Neural Network

Table 5

Details of network training with different superparameter settings.

No.	Hidden layer	Network structure	Initial learning rate	Batch size	Activation function	Optimization method	Max val acc (%)	No. Epochs	Test acc (%)
1	2	4-2-4	0.05	100	ReLU	SGD + momentum	92.64	33	91.304
2	2	4-2-4	0.05	250	ReLU	SGD + momentum	93.31	82	92.642
3	2	4-2-4	0.05	500	ReLU	SGD + momentum	91.64	91	90.97
4	2	4-2-4	0.05	500	LeakyReLU	SGD + momentum	91.30	75	93.98
5	2	4-2-4	0.05	500	LeakyReLU	Adam	92.98	67	91.304
6	2	4-2-4	0.01	500	LeakyReLU	Adam	92.64	82	91.973
7	4	4-4-4	0.05	100	ReLU	SGD + momentum	93.98	43	94.649
8	8	4-8-4	0.05	100	ReLU	SGD + momentum	93.31	10	93.98
9	8	4-8-4	0.05	250	ReLU	SGD + momentum	93.65	14	93.98
10	8	4-8-4	0.05	500	ReLU	SGD + momentum	93.98	13	94.649
11	8	4-8-4	0.05	500	LeakyReLU	SGD + momentum	93.65	21	94.314
12	8	4-8-4	0.05	500	LeakyReLU	Adam	93.65	41	94.649
13	8	4-8-4	0.01	500	LeakyReLU	Adam	93.31	73	94.983
14	12	4-12-4	0.05	100	ReLU	SGD + momentum	94.65	5	93.645
15	16	4-16-4	0.05	100	ReLU	SGD + momentum	93.65	3	93.98
16	3/3	4-3-3-4	0.05	100	ReLU	SGD + momentum	92.98	27	94.314
17	3/3	4-3-3-4	0.05	250	ReLU	SGD + momentum	92.98	27	94.649
18	3/3	4-3-3-4	0.05	500	ReLU	SGD + momentum	93.31	61	92.977
19	3/3	4-3-3-4	0.05	500	LeakyReLU	SGD + momentum	93.65	90	94.314
20	3/3	4-3-3-4	0.05	500	LeakyReLU	Adam	93.31	50	94.983
21	3/3	4-3-3-4	0.01	500	LeakyReLU	Adam	92.31	86	93.311
22	7/7	4-7-7-4	0.05	100	ReLU	SGD + momentum	93.65	36	94.314
23	10/10	4-10-10-4 (Dropout)	0.05	100	ReLU	SGD + momentum	92.98	48	94.983
24	15/15	4-15-15-4 (Dropout)	0.05	100	ReLU	SGD + momentum	93.98	31	94.983
25	15/15	4-15-15-4 (Dropout)	0.05	250	ReLU	SGD + momentum	92.98	11	93.98
26	15/15	4-15-15-4 (Dropout)	0.05	500	ReLU	SGD + momentum	93.31	16	94.314
27	15/15	4-15-15-4 (Dropout)	0.05	500	LeakyReLU	SGD + momentum	93.65	20	94.983
28	15/15	4-15-15-4 (Dropout)	0.05	500	LeakyReLU	Adam	94.98	11	94.983
29	15/15	4-15-15-4 (Dropout)	0.01	500	LeakyReLU	Adam	91.97	35	93.645