SSGD: A Safe and Efficient Method of Gradient Descent

Table 6

Test accuracy with ε = 2 on Fashion-MNIST.

SGDm\Adam\SSGDm	n = 4	n = 8	n = 16	n = 32	n = 64
m = 4	0.7089\0.7177\0.7732	0.7623\0.7729\0.7875	0.7894\0.7813\0.7947	0.7941\0.81800.8233	0.8108\0.8192\0.8343
m = 8	0.7123\0.7402\0.7885	0.7658\0.7548\0.8040	0.7806\0.80220.8175	0.8044\0.8242\0.8412	0.8159\0.83730.8459
m = 16	0.7127\0.7723\0.7903	0.7763\0.8052\0.8139	0.7724\0.8173\0.8389	0.7993\0.82910.8474	0.8199\0.8386\0.8455
m = 32	0.7159\0.8013\0.8177	0.7669\0.8066\0.8333	0.7735\0.83390.8467	0.8103\0.8540\0.8611	0.8299\0.85530.8597
m = 64	0.7158\0.8140\0.8235	0.7432\0.8309\0.8412	0.7853\0.8497\0.8524	0.8064\0.85860.8647	0.8283\0.8663\0.8655