[Retracted] Gradient Descent Optimization in Deep Learning Model Training Based on Multistage and Method Combination Strategy

Table 5

Executing time of conflicting situations on the learning rate.

Methods	Decay	1R1D	2R2D	3R3D	5R5D
RMSprop	100	108	109	111	113
Adam	109	122	124	126	129
NAdam	124	142	145	146	149
AdaMax	115	139	141	143	147
Adadelta	129	162	165	168	176
Adagrad	128	167	170	171	173

Unit: s/epoch; kRkD: raise k times and decrease k times on learning rate for each iteration.