AdaCN: An Adaptive Cubic Newton Method for Nonconvex Stochastic Optimization

Table 3

Test accuracy of VGG11, ResNet34, and DenseNet121 on CIFAR10.

Model	Adam	SGD	AdaBound	Apollo	AdaCN
VGG11	88.40	89.72	90.60	88.90	91.34
ResNet34	93.02	93.62	94.75	94.79	95.15
DenseNet121	92.79	93.07	94.58	94.85	95.52

The best results are shown in bold.