Research Article

[Retracted] Gradient Descent Optimization in Deep Learning Model Training Based on Multistage and Method Combination Strategy

Table 9

Performance of the proposed method, RMSprop.

ResNet-20 on Cafri-10LSTM on IMDB
Val-lossVal-accVal-lossVal-acc

RMSprop + SGD0.59680.85130.48590.8358
RMSprop + (SGD + d)0.58890.85290.46760.8344
RMSprop + (SGD + M)0.73470.80570.56720.8311
RMSprop + (SGD + M + d)0.88320.77540.55830.8309
RMSprop + RMSprop0.81390.79780.81280.8143
RMSprop + (RMSprop + d)0.79600.79270.77150.8126
RMSprop + Adam0.97900.75130.98480.8129
RMSprop + (Adam + d)0.67240.82580.95560.8126

The bold values represent the best results.